2026-01-03 23:00:11 [scrapy.utils.log] (PID: 126) INFO: Scrapy 2.12.0 started (bot: catalog_extraction)
2026-01-03 23:00:11 [scrapy.utils.log] (PID: 126) INFO: Versions: lxml 5.3.1.0, libxml2 2.12.9, cssselect 1.3.0, parsel 1.10.0, w3lib 2.3.1, Twisted 24.11.0, Python 3.11.13 (main, Jun 10 2025, 23:54:42) [GCC 12.2.0], pyOpenSSL 25.0.0 (OpenSSL 3.4.1 11 Feb 2025), cryptography 44.0.2, Platform Linux-6.9.12-x86_64-with-glibc2.36
2026-01-03 23:00:11 [mcmaster_carr] (PID: 126) INFO: Starting extraction spider mcmaster_carr...
2026-01-03 23:00:11 [scrapy.addons] (PID: 126) INFO: Enabled addons:
[]
2026-01-03 23:00:11 [py.warnings] (PID: 126) WARNING: /usr/local/lib/python3.11/site-packages/scrapy/utils/request.py:120: ScrapyDeprecationWarning: 'REQUEST_FINGERPRINTER_IMPLEMENTATION' is a deprecated setting.
It will be removed in a future version of Scrapy.
  return cls(crawler)

2026-01-03 23:00:11 [scrapy.extensions.telnet] (PID: 126) INFO: Telnet Password: 32fe45815017f7fe
2026-01-03 23:00:11 [py.warnings] (PID: 126) WARNING: /var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/extensions/bq_feedstorage.py:33: ScrapyDeprecationWarning: scrapy.extensions.feedexport.build_storage() is deprecated, call the builder directly.

2026-01-03 23:00:11 [scrapy.middleware] (PID: 126) INFO: Enabled extensions:
['scrapy.extensions.corestats.CoreStats',
 'scrapy.extensions.telnet.TelnetConsole',
 'scrapy.extensions.memusage.MemoryUsage',
 'scrapy.extensions.closespider.CloseSpider',
 'scrapy.extensions.feedexport.FeedExporter',
 'scrapy.extensions.logstats.LogStats',
 'spidermon.contrib.scrapy.extensions.Spidermon']
2026-01-03 23:00:11 [scrapy.crawler] (PID: 126) INFO: Overridden settings:
{'BOT_NAME': 'catalog_extraction',
 'CONCURRENT_ITEMS': 250,
 'CONCURRENT_REQUESTS': 8,
 'DOWNLOAD_DELAY': 0.9,
 'FEED_EXPORT_ENCODING': 'utf-8',
 'LOG_FILE': '/var/lib/scrapyd/logs/catalog_extraction/mcmaster_carr/f15853a8e8f711f0a8e84200a9fe0102.log',
 'LOG_FORMAT': '%(asctime)s [%(name)s] (PID: %(process)d) %(levelname)s: '
               '%(message)s',
 'LOG_LEVEL': 'INFO',
 'NEWSPIDER_MODULE': 'catalog_extraction.spiders',
 'REQUEST_FINGERPRINTER_CLASS': 'scrapy_poet.ScrapyPoetRequestFingerprinter',
 'REQUEST_FINGERPRINTER_IMPLEMENTATION': '2.7',
 'RETRY_HTTP_CODES': [500, 502, 503, 504, 522, 524, 408, 429, 420],
 'SPIDER_MODULES': ['catalog_extraction.spiders'],
 'TWISTED_REACTOR': 'twisted.internet.asyncioreactor.AsyncioSelectorReactor',
 'USER_AGENT': None}
2026-01-03 23:00:12 [scrapy_poet.injection] (PID: 126) INFO: Loading providers:
 [<class 'scrapy_poet.page_input_providers.HttpRequestProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpResponseProvider'>,
 <class 'scrapy_poet.page_input_providers.HttpClientProvider'>,
 <class 'scrapy_poet.page_input_providers.PageParamsProvider'>,
 <class 'scrapy_poet.page_input_providers.RequestUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.ResponseUrlProvider'>,
 <class 'scrapy_poet.page_input_providers.StatsProvider'>]
2026-01-03 23:00:12 [scrapy.middleware] (PID: 126) INFO: Enabled downloader middlewares:
['scrapy.downloadermiddlewares.offsite.OffsiteMiddleware',
 'scrapy.downloadermiddlewares.httpauth.HttpAuthMiddleware',
 'scrapy.downloadermiddlewares.downloadtimeout.DownloadTimeoutMiddleware',
 'scrapy.downloadermiddlewares.defaultheaders.DefaultHeadersMiddleware',
 'scraping_utils.middlewares.downloaders.ProxyManagerDownloaderMiddleware',
 'scrapy.downloadermiddlewares.useragent.UserAgentMiddleware',
 'scrapy.downloadermiddlewares.httpproxy.HttpProxyMiddleware',
 'scraping_utils.middlewares.downloaders.HeadersSpooferDownloaderMiddleware',
 'scrapy_poet.InjectionMiddleware',
 'scrapy.downloadermiddlewares.retry.RetryMiddleware',
 'scrapy.downloadermiddlewares.redirect.MetaRefreshMiddleware',
 'scrapy.downloadermiddlewares.httpcompression.HttpCompressionMiddleware',
 'scrapy.downloadermiddlewares.redirect.RedirectMiddleware',
 'scrapy.downloadermiddlewares.cookies.CookiesMiddleware',
 'scrapy_poet.DownloaderStatsMiddleware']
2026-01-03 23:00:12 [NotFoundHandlerSpiderMiddleware] (PID: 126) INFO: NotFoundHandlerSpiderMiddleware running on PRODUCTION environment.
2026-01-03 23:00:12 [scrapy.middleware] (PID: 126) INFO: Enabled spider middlewares:
['catalog_extraction.middlewares.NotFoundHandlerSpiderMiddleware',
 'catalog_extraction.middlewares.FixtureSavingMiddleware',
 'scrapy_poet.RetryMiddleware',
 'scrapy.spidermiddlewares.referer.RefererMiddleware',
 'scrapy.spidermiddlewares.urllength.UrlLengthMiddleware',
 'scrapy.spidermiddlewares.depth.DepthMiddleware']
2026-01-03 23:00:12 [scrapy.middleware] (PID: 126) INFO: Enabled item pipelines:
['catalog_extraction.pipelines.DuplicatedSKUsFilterPipeline',
 'catalog_extraction.pipelines.DiscontinuedProductsAdjustmentPipeline',
 'catalog_extraction.pipelines.PriceRoundingPipeline',
 'scraping_utils.pipelines.AttachSupplierPipeline',
 'spidermon.contrib.scrapy.pipelines.ItemValidationPipeline']
2026-01-03 23:00:12 [scrapy.core.engine] (PID: 126) INFO: Spider opened
2026-01-03 23:00:12 [scrapy.extensions.closespider] (PID: 126) INFO: Spider will stop when no items are produced after 1800 seconds.
2026-01-03 23:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 0 pages (at 0 pages/min), scraped 0 items (at 0 items/min)
2026-01-03 23:00:12 [scrapy.extensions.telnet] (PID: 126) INFO: Telnet console listening on 127.0.0.1:6024
2026-01-03 23:00:18 [ProxyManagerDownloaderMiddleware] (PID: 126) INFO: Using brd-customer-hl_13cda1e4-zone-sharedpool_datacenter_proxy as the default proxy for ProxyManagerDownloaderMiddleware.
2026-01-03 23:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~m10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/flexibility~flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/for-use-on~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cold-galvanizing-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~1-3-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-bolt-together-structural-framing-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~1-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-clamp-on-structural-framing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446574%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/flexibility~flexible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003347873%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/american-wire-gauge-awg~26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-fitting-nuts/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3223A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223223A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000107304%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/insulation/for-use-on~brass/
2026-01-03 23:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3274A131&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223274A131%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~18-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/shape~film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/wire-gauge~26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/shape~ring/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40 pages (at 40 pages/min), scraped 1 items (at 1 items/min)
2026-01-03 23:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003311994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-electrical-fitting-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-connectors/number-of-poles~19/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3223A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223223A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~18-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/wire-gauge~26/
2026-01-03 23:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/shape~film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collision-warning-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~18-mm/
2026-01-03 23:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/shape~ring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jobsite-boxes/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/number-of-poles~19&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3223A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223223A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bubble-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1712501638756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1712501638756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551445%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/invar-rod-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=column-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-jobsite-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6168T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226168T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:01:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3223A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223223A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/u-s-state-territory~iowa/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iron-steel-ansi-pipe-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=invar-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mop-wringers/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bucket-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iron-end-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 87 pages (at 47 pages/min), scraped 2 items (at 1 items/min)
2026-01-03 23:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iron-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iowa-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-and-steel-ansi-pipe-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-mop-wringers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-mesh/construction~crimped/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-end-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-pipe-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iron-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-protection-sleeving/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iso-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-mesh/construction~crimped&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/quick-disconnect-style~iso-series-b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/isolation-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4656499217167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4656499217167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002421961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-protection-sleeving&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=commercial-bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9327T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229327T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-series-b-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=isolation-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~1/
2026-01-03 23:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 131 pages (at 44 pages/min), scraped 2 items (at 0 items/min)
2026-01-03 23:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~10-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~5-16-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~m24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9327T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229327T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-threaded-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=commercially-pure-nickel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jancy-slugger-magnetic-base-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:33 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~10-32&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkhead-tank-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-wire-brooms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jars/capacity~11-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9327T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229327T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jancy-slugger-magnetic-base-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-screws/length~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stencil-ink-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-food-grade-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:03:59 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jars/capacity-weight-~11-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:01 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m24&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-lug-terminals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9327T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229327T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/jars/capacity-weight-~11-ml/
2026-01-03 23:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 183 pages (at 52 pages/min), scraped 2 items (at 0 items/min)
2026-01-03 23:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jig-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/length~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knives/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-screws/screw-size~no-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-mouse-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motor-gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001600372%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stereo-microscopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jig-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/kalrez-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=woodworking-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/workbench-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/screw-size~no-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334626%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/kevlar-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stick-electrodes/diameter~7-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conductive-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/kevlar-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/workbenches/mobility~mobile/top-material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kalrez-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbench-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9938597167718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stick%20electrodes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9938597167718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~1-2-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kevlar-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 230 pages (at 47 pages/min), scraped 2 items (at 0 items/min)
2026-01-03 23:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kevlar-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbenches/mobility~mobile/top-material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/fitting-type~support-clip/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stirring-paddles/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8316204383934&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8316204383934%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stirring-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stock/material~petg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/driver-style~bit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4630489527058&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stirring%20paddles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4630489527058%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/conduit/thread-size~5-16-24/
2026-01-03 23:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995947086760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stock&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995947086760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/type~support-clip&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stock/material~pps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~0536/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-set-screw-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/conduit/type~support-clip/
2026-01-03 23:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/driver-style~bit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995947086760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stock&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995947086760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541260%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stones/color~orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0536&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0645&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1007la/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951022873847&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stones&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951022873847%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cone-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0915&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~0645/
2026-01-03 23:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 280 pages (at 50 pages/min), scraped 2 items (at 0 items/min)
2026-01-03 23:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1043j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~0915/
2026-01-03 23:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~104am/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1007la&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~12g056/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~16g020/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951022873847&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stones&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951022873847%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~boric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~1007la/
2026-01-03 23:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1043j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~hydrogen-bromide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~104am&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964962%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~1043j/
2026-01-03 23:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967470%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~12g056&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~16g020&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951022873847&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stones&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951022873847%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~104am/
2026-01-03 23:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/nema-type~l20-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stopwatches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/storage/material~foam-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951022873847&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stones&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951022873847%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:07:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/nema-style~l20-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 328 pages (at 48 pages/min), scraped 4 items (at 2 items/min)
2026-01-03 23:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~36247/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=storage-bins/space-saving-features~collapsible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/connectors/nema-style~l20-30/
2026-01-03 23:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=storage/material~foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/specifications-met~din-3870&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~100-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7548746761995&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=storage%20bins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7548746761995%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~160-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~0-1-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~20-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/storage/material~foam/
2026-01-03 23:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~36247&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086531%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128503%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~200-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400525%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7903N128&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227903N128%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7548746761995&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=storage%20bins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7548746761995%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~0-1-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wye-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~a1515/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7548746761995&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=storage%20bins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7548746761995%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~31-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~b74/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wye-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~0-1-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a1515&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 378 pages (at 50 pages/min), scraped 6 items (at 2 items/min)
2026-01-03 23:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~4-5-gal/capacity~4-1-2-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strap-tension-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081483%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~a1515/
2026-01-03 23:08:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7548746761995&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=storage%20bins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7548746761995%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4121T3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224121T3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~b74&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139150%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/strainers/material~brass/
2026-01-03 23:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/xl-series-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081483%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~0-1-ml&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~d1054k/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~b74/
2026-01-03 23:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~ea47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/butterfly-nuts/material~zinc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~8-1-4-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straps/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zinc-anchors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~p120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=xl-series-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~d1054k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~ea47&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-alloy-butterfly-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:08:59 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~8-1-4-gal&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~p120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~d1054k/
2026-01-03 23:09:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~ea47/
2026-01-03 23:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m12-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~p175/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/straps/material~brass/
2026-01-03 23:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 422 pages (at 44 pages/min), scraped 7 items (at 1 items/min)
2026-01-03 23:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~4-7-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/overall-length~1-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000009660048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~sc8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stretch-wrap/material~polyethylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~p175&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=string-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~4-7-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~1-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400501%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~sm866/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sc8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~7-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8246808234932&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stretch%20wrap&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8246808234932%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~16-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~4-7-ml/
2026-01-03 23:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001625480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~x2417/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~sc8/
2026-01-03 23:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001586981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001625480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~1-7-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~y14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/manufacturer-equivalent~esp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sm866&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~7-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~x2417&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~7-gal-/
2026-01-03 23:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~8-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=converters/transformer-voltage-function~step-up&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 467 pages (at 45 pages/min), scraped 7 items (at 0 items/min)
2026-01-03 23:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~y14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/manufacturer~esp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972458907270&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=converters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972458907270%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002058319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~y14/
2026-01-03 23:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/manufacturer~esp/
2026-01-03 23:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~8-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972458907270&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=converters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972458907270%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002058319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=converters/transformer-voltage-function~step-up&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keystone-jacks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=convex-radius-end-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591276%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belts/material~nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-brush-holders/backing-width~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-brushes/food-industry-standard~fda-compliant-21-cfr-177-1520&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3496939935355&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3496939935355%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511113%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keystone-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/width~20mm/
2026-01-03 23:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-chain-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strut-channel-nuts/thread-size~m6-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5546066553624&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brush%20holders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5546066553624%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7377080483436&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7377080483436%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124342%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-guide-mounting-rods/length~400-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knob-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 515 pages (at 48 pages/min), scraped 7 items (at 0 items/min)
2026-01-03 23:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/mount-type~adhesive-back/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1469N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221469N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7984217990893&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20guide%20mounting%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7984217990893%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001601985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/struts/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strut-channel-nuts/thread-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7984217990893&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20guide%20mounting%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7984217990893%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001601985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-guide-mounting-rods/length~400-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-roller-covers/color~white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/between-frame-width~13-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knob-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/strut-channel-nuts/thread-size~m6/
2026-01-03 23:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knockout-hole-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/l-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/mount-type~adhesive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6065334404961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20roller%20covers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6065334404961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000110791%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5872K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225872K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T494&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T494%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/struts/material~aluminum/
2026-01-03 23:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knockout-hole-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-dispenser-hose-on-off-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=suction-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lags/screw-size~m8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5872K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225872K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=suitcase-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 566 pages (at 51 pages/min), scraped 9 items (at 2 items/min)
2026-01-03 23:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stick-electrodes/for-joining~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cooler-curtains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sump-pump-basins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sump-pump-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-knob-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lags/screw-size~m8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5872K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225872K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-pro-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9974560404121&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9974560404121%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105210%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/latching-power-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-based-stick-electrodes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~m16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~m40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5872K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225872K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=support-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-series~selectronic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-series~waterfree/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latching-power-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~m16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~m40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/knockout-trade-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/thread-size~m16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~111-1-28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/thread-size~pg-13-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/for-knockout-trade-size~m16/
2026-01-03 23:13:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/for-knockout-trade-size~m40/
2026-01-03 23:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/for-manufacturer-series~selectronic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 613 pages (at 47 pages/min), scraped 9 items (at 0 items/min)
2026-01-03 23:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3111105495877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cord%20grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3111105495877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002195012%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/for-manufacturer-series~waterfree&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3111105495877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cord%20grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3111105495877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-strips/electrical-protection-type~surge-suppression/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~169-986a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3111105495877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cord%20grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3111105495877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/for-manufacturer-series~selectronic/
2026-01-03 23:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8183K7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228183K7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/for-manufacturer-series~waterfree/
2026-01-03 23:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/surveyors-transits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7310K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227310K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~111-1-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69915K116&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269915K116%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surge-suppressor-outlets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/connects-to~electrical-box/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surge-suppressor-power-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~169-986a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/cable-designation~rg-62a-u/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surveyors%27-transits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rags/rag-type~sweatshirt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130398%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~6-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/connection-type~electrical-box&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/electrical-connection~xlr3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~a-19-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/connection-type~electrical-box/
2026-01-03 23:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sweeper-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/electrical-connection~xlr3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/industry-designation~rg-62a-u&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sweatshirt-rags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~6-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 659 pages (at 46 pages/min), scraped 12 items (at 3 items/min)
2026-01-03 23:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/industry-designation~rg-62a-u/
2026-01-03 23:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~a-19-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/serial-port-interface~rs-232&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/nema-style~6-15/
2026-01-03 23:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~efp103/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~16v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/pin-connection-type~xlr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118977%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-ec13/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001567256%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/pin-connection-type~xlr/
2026-01-03 23:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~480v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:34 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118977%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~a-19-ac&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~6v-dc-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5928N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225928N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~efp103&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/actuator-style~rocker-switch-with-mini-slide-dimmer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552951%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-ec13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5839K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225839K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corn-cob-abrasive-blasting-media&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/material~iron/
2026-01-03 23:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-j1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131175%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/actuator-style~rocker-with-mini-slide-dimmer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/certification~enec-marked&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/actuator-style~rocker-with-mini-slide-dimmer/
2026-01-03 23:15:09 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131175%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-ec13&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 709 pages (at 50 pages/min), scraped 14 items (at 2 items/min)
2026-01-03 23:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~s05-054c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~1-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corner-rounders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~17-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-j1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/screw-size~m5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/enclosure-rating~nema-3r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8085T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228085T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140384%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000120458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~s05-054c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~1-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~17-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140384%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-j1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/for-screw-size~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8085T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228085T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~1-3-8/
2026-01-03 23:15:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:15:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~17-32/
2026-01-03 23:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/countersinks/for-screw-size~5-mm/
2026-01-03 23:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/led-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leds/bulb-shape-number~a23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~19-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~alkali/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8085T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228085T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/fitting-connection~o-ring-face-seal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leveling-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/level-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=led-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=LEDs/bulb-shape-number~a23&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~dust&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 754 pages (at 45 pages/min), scraped 14 items (at 0 items/min)
2026-01-03 23:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~19mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364464%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~alkalies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948839639468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948839639468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002060807%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002991259%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8085T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228085T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:16:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-shaft-diameter~19mm/
2026-01-03 23:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leveling-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6407T841&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226407T841%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-use-with~alkalies/
2026-01-03 23:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=level-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/mount-type~clamp-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1449T36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221449T36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7133N6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227133N6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~2-2-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~hydrogen-fluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~140-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~refrigerant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965331%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/mount-type~clamp-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~2-2a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~natural-gas-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~petroleum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~sodium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A515&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A515%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~wood-chips/for-use-with~wood-shavings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/switching-current~2-2a/
2026-01-03 23:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001628959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~refrigerant-gases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4942K1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224942K1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/pipe-size~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964993%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 806 pages (at 52 pages/min), scraped 18 items (at 4 items/min)
2026-01-03 23:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6564K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226564K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-use-with~refrigerant-gases/
2026-01-03 23:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5428K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225428K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4515K208&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224515K208%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~65-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964993%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6564K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226564K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shape~270-bend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levers/clamp-type~c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001584912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310632%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6323T92&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226323T92%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~1-20-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964993%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6564K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226564K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-raceways&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-restraints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1906N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221906N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levers/clamp-type~c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978677157349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978677157349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~1-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964993%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:18:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6564K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226564K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 857 pages (at 51 pages/min), scraped 23 items (at 5 items/min)
2026-01-03 23:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/thread-size~1-20/
2026-01-03 23:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lifts/fitting-type~thimble/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~3-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~7-8-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-type~npsc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978677157349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978677157349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~3-4-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tie-downs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-pipe-fitting-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333387%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121647%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifts/type~thimble&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93023A661&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293023A661%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=46685K261&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2246685K261%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/lifts/type~thimble/
2026-01-03 23:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978677157349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978677157349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~g13/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~g5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-diffusers/lens-pattern~cracked-ice/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cr1025-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape-number~bt28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crane-pendant-enclosures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978677157349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978677157349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-number~g13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-number~g5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cracked-ice-light-diffusers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 911 pages (at 54 pages/min), scraped 25 items (at 2 items/min)
2026-01-03 23:19:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/base-number~g13/
2026-01-03 23:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=creamery-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/base-number~g5/
2026-01-03 23:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape-number~bt28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/shape~z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/color~frosted/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-1-4-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002057138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309003%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1157a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~10-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8352K27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228352K27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~m7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1092K26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221092K26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-1-4-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/color~frosted&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1157a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002194059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~12psb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2333N263&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222333N263%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1092K26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221092K26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:19:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1157a/
2026-01-03 23:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~19-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/drive-size~20-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 958 pages (at 47 pages/min), scraped 27 items (at 2 items/min)
2026-01-03 23:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1823/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~243/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~12psb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~11-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/drive-size~20-mm-1/
2026-01-03 23:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~2821/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1092K26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221092K26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~19-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crushers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~12psb/
2026-01-03 23:20:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/size~11-mm/
2026-01-03 23:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~300t3q-cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/size~19-mm/
2026-01-03 23:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1823&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~243&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3156/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~2821&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1092K26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221092K26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:20:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1823/
2026-01-03 23:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~243/
2026-01-03 23:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~t40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=custom-magnetic-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~300t3q-cl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~2821/
2026-01-03 23:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3456ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caliper-calibrators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~7219/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3156&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~300t3q-cl/
2026-01-03 23:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~7506/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cut-to-length-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:20:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~3156/
2026-01-03 23:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/drive-size~t40-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3456ll&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~cx120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~outlet-strip/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~7219&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/drive-size~t40-1/
2026-01-03 23:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1005 pages (at 47 pages/min), scraped 27 items (at 0 items/min)
2026-01-03 23:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutting-board-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~7506&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~3456ll/
2026-01-03 23:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutting-glasses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~909/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~7219/
2026-01-03 23:21:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~7506/
2026-01-03 23:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~97/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~921/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cx120-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~outlet-strip&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~g15t8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~909&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~outlet-strip/
2026-01-03 23:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=damper-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=data-transmission-wall-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~97&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~921&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-label-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~909/
2026-01-03 23:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~97/
2026-01-03 23:21:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~921/
2026-01-03 23:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~h7635/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~g15t8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-rails/rail-height~20-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~15v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=decals/message~push&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~g15t8/
2026-01-03 23:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t6-1%252f2-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981597435777&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=decals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981597435777%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002260147%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1052 pages (at 47 pages/min), scraped 27 items (at 0 items/min)
2026-01-03 23:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~2-5v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-gauges/manufacturer-model-number~236hb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~h7635&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-gauges/manufacturer-model-number~445azz-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~18v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~15v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9062N117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229062N117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8692897390024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=depth%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8692897390024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123360%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~h7635/
2026-01-03 23:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8692897390024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=depth%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8692897390024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003516005%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~2-5v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~48v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2090A2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222090A2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K77&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K77%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-gauges/manufacturer-model-number~900367&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553741%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~18v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~6-3v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9062N117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229062N117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~7v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=table-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8692897390024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=depth%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8692897390024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087517%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~48v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tables/top-weight-capacity~not-rated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~6-3v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9062N117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229062N117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~7v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~1-66-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1102 pages (at 50 pages/min), scraped 31 items (at 4 items/min)
2026-01-03 23:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552942%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tables/top-capacity~not-rated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tabletop-blenders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tack-cloths&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~12-5-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9062N117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229062N117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tables/top-capacity~not-rated/
2026-01-03 23:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~1-66w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~1-66w/
2026-01-03 23:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/15-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~12-5w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~3-6-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-board-sensor-modules/infrared-sensor-type~thermal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/300-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tag-lines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~12-5w/
2026-01-03 23:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-evident-paint/color~white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9580658925258&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=development%20board%20sensor%20modules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9580658925258%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005427976%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~15w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:23:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~3-6w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5115635525171&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tamper%20evident%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5115635525171%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8194N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228194N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~15w/
2026-01-03 23:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~6-4-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~300w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~193595g&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:24:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~3-6w/
2026-01-03 23:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1476T621&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221476T621%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~8-25-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1151 pages (at 49 pages/min), scraped 34 items (at 3 items/min)
2026-01-03 23:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~300w/
2026-01-03 23:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~9-3-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078504%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~6-4w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-443-16t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1476T621&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221476T621%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~8-25w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~pt07137&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~6-4w/
2026-01-03 23:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~pt23942&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~9-3w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~8-25w/
2026-01-03 23:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140541%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linear-motion-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~9-3w/
2026-01-03 23:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-strap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1476T621&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221476T621%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-tape-measures/blade-color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-motion-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~11-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~14-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linear-shaft-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1476T621&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221476T621%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001489809%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diamond-grinding-points&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1202 pages (at 51 pages/min), scraped 34 items (at 0 items/min)
2026-01-03 23:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diamond-grit-reciprocating-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141144%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001489809%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-tape-measures/blade-color~yellow&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liners/flexibility~extra-flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linkage-arms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-shaft-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~1-3-8-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liners/flexibility~very-flexible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~60-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linkage-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cardan-joints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=card-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-lifting-tongs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/liners/flexibility~very-flexible/
2026-01-03 23:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~1-3-8-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locker-door-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-20-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~1-3-8-gal-/
2026-01-03 23:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-2-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lockers/cabinet-type~bin-box/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locking-panel-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locker-door-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1251 pages (at 49 pages/min), scraped 34 items (at 0 items/min)
2026-01-03 23:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-4-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-72&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-967-18-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockers/cabinet-type~bin-box&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-panel-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dies/thread-size~1-20/
2026-01-03 23:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locknut-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lockout-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449201%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2628760537036&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2628760537036%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146537%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locks/for-use-on~sheds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4905T45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224905T45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~2-933-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locknut-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockout-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=case-hardened-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/for-use-on~sheds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-404/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-4161/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~2-933-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-9462/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930309%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dies/thread-size~2-933-12/
2026-01-03 23:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1297 pages (at 46 pages/min), scraped 35 items (at 1 items/min)
2026-01-03 23:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~3-5-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-caulk/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-404&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-4161&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001592516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-m-31cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-9462&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model~control-series&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-caulk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-rail-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004931627%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loops/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-m-31cl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-rail-mount-circuit-breakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~l1216b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=catwalk-flooring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:50 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004931627%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model~control-series&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loose-pin-butt-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lord-epoxy-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:27:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tape-measures/manufacturer-model-number~l1216b/
2026-01-03 23:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loops/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/exhaust-fans/drive-type~direct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strip-doors/performance~low-temperature-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-rulers/manufacturer~stanley&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loose-pin-butt-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dip-coating-pots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lord-epoxy-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/loops/material~fiberglass/
2026-01-03 23:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1347 pages (at 50 pages/min), scraped 35 items (at 0 items/min)
2026-01-03 23:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taper-bolt-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=direct-burial-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9942415585721&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9942415585721%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002256836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=direct-drive-exhaust-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-temperature-strip-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-use-on~precision-measurement-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/manufacturer~chemours/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-grease/for-use-on~open-gears/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceiling-grates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disposable-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-use-on~precision-measurement-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/manufacturer~chemours&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/open-gear-and-chain-grease-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/luer-lock-tips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=center-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=centering-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002240420%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%22290803211686%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2278N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222278N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4328T314&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224328T314%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1395 pages (at 48 pages/min), scraped 35 items (at 0 items/min)
2026-01-03 23:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=luer-lock-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/m12-power-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=document-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=centrifugal-well-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-feet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machinery-spacer-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/made-to-order-spacers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4328T314&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224328T314%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=m12-power-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-base-drill-cutting-fluids/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/taps/thread-size~1-4-28/
2026-01-03 23:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machinery-spacer-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=made-to-order-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4328T314&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224328T314%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-base-drill-cutting-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~5-16-24-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~5-16-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-retractable-belt-barriers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnets/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4328T314&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224328T314%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1443 pages (at 48 pages/min), scraped 37 items (at 2 items/min)
2026-01-03 23:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circular-saws/manufacturer~makita-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~9-16-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/for-use-with~coolant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/for-use-with~oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-retractable-belt-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/finish~zinc-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tarp-repair-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=makita-circular-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3815738403502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3815738403502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/for-use-with~coolant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/for-use-with~oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manual-hoists/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/marine-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/markers/color~clear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=teach-pendant-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-055&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/markers/color~fluorescent-yellow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manual-hoists&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marine-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1490 pages (at 47 pages/min), scraped 37 items (at 0 items/min)
2026-01-03 23:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~clear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-095&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:31:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-055&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527245%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/markers/mount-type~nail-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~fluorescent-yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533461%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-104&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-106&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533461%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-095&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103908%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-122&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551033%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-nuts/thread-size~7-8-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1254&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/masking-tape/color~green-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/mount-type~nail-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/masks/for-use-with~nuisance-dust/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:48 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103908%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-104&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:50 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551033%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-106&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tee%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010742%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/masks/for-use-with~solid-particles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-122&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:32:03 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1254&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/material-lifts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masking-tape/color~green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masks/for-use-with~nuisance-dust&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1883&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mats/for-use-with~diesel-fuel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1537 pages (at 47 pages/min), scraped 37 items (at 0 items/min)
2026-01-03 23:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/masking-tape/color~green/
2026-01-03 23:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/for-use-with~resin/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masks/for-use-with~solid-particles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3028195520048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3028195520048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526577%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mechanics-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-222&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=material-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3028195520048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3028195520048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967751%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-2503&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=55815T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2255815T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526577%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1883&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/for-use-with~diesel-fuel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/for-use-with~resins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001532608%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/mats/for-use-with~diesel-fuel/
2026-01-03 23:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mechanics-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-222&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:32:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tees/for-use-with~resins/
2026-01-03 23:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mercury-vapor-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:45 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001532608%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-2503&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/specifications-met~ifgc-compliant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mesh/mesh-size~12-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/fastener-head-type~set-screw-flat/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/made-to-order-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/specifications-met~sae-j2494-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977791246039&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tees&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977791246039%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334503%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~7-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mercury-vapor-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977791246039&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tees&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977791246039%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136196%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telephone-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3360N164&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223360N164%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~12-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/head-type~set-screw-flat&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1586 pages (at 49 pages/min), scraped 38 items (at 1 items/min)
2026-01-03 23:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telephone-signal-generators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/made-to-order-pins-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51915K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251915K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:18 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~7-64&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053135%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dowel-pins/head-type~set-screw-flat/
2026-01-03 23:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mesh/mesh-size~300-300/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%22276432973296%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-air-directional-control-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3360N164&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223360N164%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4620N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224620N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51915K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251915K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-controllers/enclosure-rating~ip20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-nipples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~300-300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-snake-leaders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9956389503914&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20controllers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9956389503914%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000062172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-air-directional-control-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3360N164&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223360N164%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-panel-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4620N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224620N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51915K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251915K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=85385T114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2285385T114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3360N164&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223360N164%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=draw-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1639 pages (at 53 pages/min), scraped 39 items (at 1 items/min)
2026-01-03 23:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4620N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224620N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawbars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51915K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251915K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-sticks/temperature-points~250-f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-sticks/temperature-points~2000-f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawers/drawer-release~lever&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-sticks/temperature-points~425-f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982146%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9970799178638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9970799178638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001999613%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dremel-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4620N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224620N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/material~cobalt-steel/shank-type~morse-taper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-switches/ul-file-number~e217884&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001979551%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temporary-outdoor-shelters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=830330883100&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B830330883100%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001577780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/cobalt-steel-morse-taper-shank-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~0-0181&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5189N113&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225189N113%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~0-0197&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~0-48-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~1-1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/cobalt-steel-morse-taper-shank-drill-bits/
2026-01-03 23:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003250423%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~1-3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003250394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003250700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~11-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1691 pages (at 52 pages/min), scraped 40 items (at 1 items/min)
2026-01-03 23:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509053%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509209%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8273079560253&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20sticks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8273079560253%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-leads/for-fluke-model-number~1587&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~27-0-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~2-3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6196421921533&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=test%20leads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6196421921533%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074669%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-strips/for-testing~phosphorus&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-weights/weight~10-kg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003250406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~50-ga-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=textured-metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9063349380392&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=test%20strips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9063349380392%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002067096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1323188756785&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=test%20weights&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1323188756785%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002004528%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~57-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=textured-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507554%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11235T75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211235T75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~7-9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermal-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1746 pages (at 55 pages/min), scraped 41 items (at 1 items/min)
2026-01-03 23:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509383%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~i&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~5-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermocouple-connector-adapters/thermocouple-type~u&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermocutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501601%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6691521965192&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thermocouple%20connector%20adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6691521965192%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002279320%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~95-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492919%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-stop-collars/performance~depth-limiting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~5-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/length~5-1-8/
2026-01-03 23:36:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~95mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermometers/mounting-location~din-rail&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-point-type~brad/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/letter-size-depth-limiting-drill-bit-stop-collars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~205-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/length~95mm/
2026-01-03 23:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6790060835426&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thermometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6790060835426%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276055%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:36:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/letter-size-depth-limiting-drill-bit-stop-collars/
2026-01-03 23:37:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000025527%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~9-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thick-wall-stainless-steel-butt-weld-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-185&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-26-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/point-style~brad&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/reduced-shank-drill-bit-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1795 pages (at 49 pages/min), scraped 41 items (at 0 items/min)
2026-01-03 23:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105081%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000095544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/point-style~brad/
2026-01-03 23:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/reduced-shank-drill-bit-stands/
2026-01-03 23:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-27-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~11-75-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-26mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050841%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealant-tape/for-use-with~benzene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105081%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~12-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~0-26mm/
2026-01-03 23:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000106572%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealant-tape/for-use-with~hydrochloric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7596424750350&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealant%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7596424750350%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967302%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~11-75mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~19-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7596424750350&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealant%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7596424750350%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6802K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226802K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~11-75mm/
2026-01-03 23:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105081%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealant-tape/for-use-with~synthetic-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117952%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/for-use-on~petg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/manufacturer-model-number~5117&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7596424750350&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealant%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7596424750350%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7596424750350&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealant%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7596424750350%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~57-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1851 pages (at 56 pages/min), scraped 42 items (at 1 items/min)
2026-01-03 23:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105081%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6802K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226802K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~6-9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8149K17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228149K17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-1-4-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7596424750350&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealant%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7596424750350%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000040078%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-shank-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threadlocker-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7596424750350&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealant%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7596424750350%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thredolets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=three-phase-disconnects&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thresholds/specifications-met~ansi-bhma-a156-21&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~28-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thumb-nuts/material~acetal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-bodies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-industry-number~10n49sc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988288685978&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thresholds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988288685978%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005439491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1904 pages (at 53 pages/min), scraped 44 items (at 2 items/min)
2026-01-03 23:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8920298804818&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thumb%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8920298804818%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-torch-nozzle-size~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004780170%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8920298804818&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thumb%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8920298804818%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thumb-nuts/material~acetal&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torches/torch-series-number~17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123875%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tilt-and-slide-clamping-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timers/environment~washdown/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8171926610323&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8171926610323%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tilt-stages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tilt-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belt-end-plates/belt-trade-size~at10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~10-at5-525&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timers/environment~washdown-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6038886283542&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belt%20end%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6038886283542%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002003794%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~16-at5-390&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~16-at5-525&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tin-snips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:39:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/timers/environment~washdown-1/
2026-01-03 23:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~tl-2300/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tire-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297661%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tires/tire-size~5-70-4-50-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295958%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 1956 pages (at 52 pages/min), scraped 44 items (at 0 items/min)
2026-01-03 23:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1409080599349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tires&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1409080599349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116775%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tl-2300-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-repair-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-spud-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-tank-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-tank-risers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-mats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=top-notch-lathe-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-angle-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-gauge-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/capacity~330-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-seal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-stripes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity~1-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity~4-1-4-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=traps/material~bronze-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity-weight-~330-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=touch-up-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:12 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity~1-gal&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2008 pages (at 52 pages/min), scraped 44 items (at 0 items/min)
2026-01-03 23:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-compactor-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/drive-style~tri-groove/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9967172976307&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=traps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9967172976307%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/totes/capacity-weight-~330-gal-/
2026-01-03 23:41:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/totes/material~aluminum/
2026-01-03 23:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=travel-limiting-lanyards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tread-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/for-use-with~lp-gas-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tri-groove-head-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=triangular-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trolley-beams&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bend-and-stay-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trolley-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/fitting-connection~socket-connect-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-use-with~lp-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/for-use-with~sulfur-oxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/food-industry-standard~fda-compliant-21-cfr-175-300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361557%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:41:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tube-fittings/for-use-with~lp-gas/
2026-01-03 23:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/flexibility~bend-and-stay&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102936%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/material~teflon-fep&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/material~tpv&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/material-grade~gpo3-fiberglass-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/flexibility~bend-and-stay/
2026-01-03 23:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~sulphur-oxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2058 pages (at 50 pages/min), scraped 44 items (at 0 items/min)
2026-01-03 23:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8014N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228014N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004064964%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003433036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/specifications-met~asme-bpe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/for-use-with~sulphur-oxide/
2026-01-03 23:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~6-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9369T555&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229369T555%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten-carbide-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turbotorch-a-11-air%252facetylene-torch-replacement-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000076905%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turkey-basters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lockable-turntables/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5262K72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225262K72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turret-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweco-compatible-insulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twin-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=type-h-grooved-dowel-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tygon-nd-100-65-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=undersized-key-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=universal-protractors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turntables/lockable-turntables-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-part-epoxy-paints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/turntables/lockable-turntables-5/
2026-01-03 23:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2111 pages (at 53 pages/min), scraped 47 items (at 3 items/min)
2026-01-03 23:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=urinal-partitions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=utility-knives/blade-type~hot&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8540872660075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=utility%20knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8540872660075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034355%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~159-h3m-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~1922v302&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~240j6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~1760-j8m-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=utility-knives/blade-type~retracting-breakaway&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~260j8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2453A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222453A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~3500-h14m-55&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~3l120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297508%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283505%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295149%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8540872660075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=utility%20knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8540872660075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281398%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284862%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=39555A68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2239555A68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295149%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~3l400&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~490j4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~4l318&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~4l630&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2163 pages (at 52 pages/min), scraped 48 items (at 1 items/min)
2026-01-03 23:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=39555A68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2239555A68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281913%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5l900&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5vx730&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283125%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283677%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5l630&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295149%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=39555A68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2239555A68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~a124&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282474%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283882%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295149%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~ax85&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~b79&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=39555A68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2239555A68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~ax103&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bb111&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282193%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283296%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bx173&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bx44&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bx48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005312910%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2217 pages (at 54 pages/min), scraped 48 items (at 0 items/min)
2026-01-03 23:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283447%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bx95&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283080%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282838%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~c65&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~cx90&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~cx68&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpa857&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpz1060&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282425%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpz1800&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~1037-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284574%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~115&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~30-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283309%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168069%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/outer-circumference~38-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026069%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/matched-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~40-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~46-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2271 pages (at 54 pages/min), scraped 48 items (at 0 items/min)
2026-01-03 23:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~v317/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~69&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~38-3125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084556%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-ring-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034521%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/v-belts/outer-circumference~38-3125inches/
2026-01-03 23:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-extensions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/precision-matched-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-stem-extensions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v317-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/v-belts/precision-matched-v-belts/
2026-01-03 23:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/dispenser-type~gravity-flow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-stems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/fitting-connection~cam-and-groove&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/fitting-connection~socket-connect-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~liquid-carbon-dioxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/valve-operation~toggle-switch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361557%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-contact-points/dial-indicator-size~agd-group-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982143%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-contact-points/manufacturer-model-number~74-106363&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/valve-type~gravity-flow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variable-pitch-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-holder-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9771K117&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229771K117%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6790T106&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226790T106%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2326 pages (at 55 pages/min), scraped 48 items (at 0 items/min)
2026-01-03 23:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/valves/valve-type~gravity-flow/
2026-01-03 23:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9657484587707&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicator%20contact%20points&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9657484587707%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicator-contact-points/dial-indicator-size~agd-group-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~2424a-19&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~2776acal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~709az&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~81850&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vcr-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136578%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vents/for-use-with~kerosene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vents/shape~tee&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vespel-polyimide-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vga-splitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003448817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2491040633414&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vents&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2491040633414%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2491040633414&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vents&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2491040633414%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002312858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2117K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222117K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torch-handles/manufacturer~victor/manufacturer-series~400/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibration-control-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=victaulic-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vinyl-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vise-grip-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2381 pages (at 55 pages/min), scraped 51 items (at 3 items/min)
2026-01-03 23:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=video-recorders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vise-handle-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corner-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=victor-400-series-oxyacetylene-torch-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=volatile-corrosion-inhibitor-envelopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=voltage-to-pressure-transducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vises/corner-clamps-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-6l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-c516l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-thermometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-vent-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washer-style-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7755808933160&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vises&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7755808933160%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%227774536975162%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-d1016/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-411/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-d716/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5017A51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225017A51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-6l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-449/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-841b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-c516l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-842/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-856b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-6l/
2026-01-03 23:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-c516l/
2026-01-03 23:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-411&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2426 pages (at 45 pages/min), scraped 51 items (at 0 items/min)
2026-01-03 23:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-d716&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5017A51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225017A51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-449&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-d1016&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-913/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-841b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-411/
2026-01-03 23:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-842&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-856b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-d716/
2026-01-03 23:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-449/
2026-01-03 23:49:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-d1016/
2026-01-03 23:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-841b/
2026-01-03 23:49:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-842/
2026-01-03 23:49:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-856b/
2026-01-03 23:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms20002-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms27183-48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms27183-59/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms27183-62/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5017A51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225017A51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-913&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-506/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-913/
2026-01-03 23:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/screw-size~no-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~din-7980&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms20002-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms27183-48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms27183-59&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms27183-62&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5017A51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225017A51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-510/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms20002-4/
2026-01-03 23:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-506&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms27183-48/
2026-01-03 23:50:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms27183-59/
2026-01-03 23:50:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms27183-62/
2026-01-03 23:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-516/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/screw-size~no-24&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-526/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-506/
2026-01-03 23:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2472 pages (at 46 pages/min), scraped 51 items (at 0 items/min)
2026-01-03 23:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-825/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms27183-41/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-510&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-516&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-510/
2026-01-03 23:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-cn532r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0516h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-526&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0863h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-825&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms27183-41&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-fn816p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-516/
2026-01-03 23:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003796652%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-526/
2026-01-03 23:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms15795-825/
2026-01-03 23:50:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~ms27183-41/
2026-01-03 23:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151900%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1515-h12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:48 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0516h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:50:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003796652%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-cn532r&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0863h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151900%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-fn816p&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002073593%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=waterless-hand-soap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-hose-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-heater-heat-elements&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=waterproof-wood-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weatherheads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weight-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2524 pages (at 52 pages/min), scraped 51 items (at 0 items/min)
2026-01-03 23:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-neck-pipe-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-together-framing-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-rods/for-joining~aluminum-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-tube-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-ground&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/aws-material-code~er70s-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-wire/aws-material-code~er308l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-chalks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004291833%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/for-joining~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/mount-type~socket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7852200896140&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7852200896140%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002327035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~160-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004291833%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/aws-material-code~er70s-7&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:51:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/welding-rods/for-joining~aluminum/
2026-01-03 23:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~4-59-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010620%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:56 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7852200896140&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7852200896140%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002327035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-wire/aws-material-code~er308l&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001939380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wilkerson-compressed-air-lubricators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001922460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wipes/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2248T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222248T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=window-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/100mxl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wing-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wipes/for-use-on~stone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:12 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001922460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~4-59-64&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2577 pages (at 53 pages/min), scraped 51 items (at 0 items/min)
2026-01-03 23:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~7-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-collet-bodies/tig-industry-number~10n28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2776320989747&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wipes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2776320989747%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930162%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cam-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wipes/for-use-on~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-collet-bodies/tig-industry-number~10n30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=100mxl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wipes/for-use-on~wood/
2026-01-03 23:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~7-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/charts/for-use-with~bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=10n28-welding-collet-bodies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000145706%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=10n30-welding-collet-bodies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~7-6mm/
2026-01-03 23:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-collets/tig-industry-number~13n20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/combination-wrenches/size~5-16/
2026-01-03 23:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-designation~sjeo&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-1895/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3d-printer-filaments/performance~conductive-2/flexibility~flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=charts/for-use-with~bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=13n20-welding-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~elb0310/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9931054749196&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9931054749196%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965407%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-designation~sjto&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2621 pages (at 44 pages/min), scraped 52 items (at 1 items/min)
2026-01-03 23:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~8-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1448K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221448K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-1895&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/conductive-flexible-3d-printer-filaments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98728A112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298728A112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003016106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000076853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/commercially-pure-copper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~elb0310&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/3d-printer-filaments/conductive-flexible-3d-printer-filaments/
2026-01-03 23:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6906K82&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226906K82%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~19-04-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/communication-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151153%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-shafts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=commercially-pure-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N73&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N73%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helical-vibration-isolators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6906K82&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226906K82%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~19-04mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~7-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~7-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=communication-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~19-04mm/
2026-01-03 23:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-linear-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/material~nickel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6906K82&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226906K82%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2669 pages (at 48 pages/min), scraped 55 items (at 3 items/min)
2026-01-03 23:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/military-specification~ms122124/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~7-64&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-brake-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/canvas-grade-industrial-laminate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/retractable-water-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~7207-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-linear-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/material~nickel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6906K82&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226906K82%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/military-specifications-met~ms122124&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bolts/thread-size~1-4-28/
2026-01-03 23:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-brake-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/helicoils/material~nickel/
2026-01-03 23:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=canvas-grade-industrial-laminate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/helicoils/military-specifications-met~ms122124/
2026-01-03 23:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/c-clip-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractable-water-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~elbb001/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/composite-angles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~7207-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~7208-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109914%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/military-specification~ms124670/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~embscn1215/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-clip-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~elbb001&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=composite-angles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax82/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chair-levelers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-013&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~7208-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2711 pages (at 42 pages/min), scraped 55 items (at 0 items/min)
2026-01-03 23:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/military-specifications-met~ms124670&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548492%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083593%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cap-nuts/thread-size~1-1-4-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~embscn1215&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N29&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N29%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/military-specification~ms124734/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax92/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax82-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/helicoils/military-specifications-met~ms124670/
2026-01-03 23:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087261%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~flammable-vapors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-pipe-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3d-printer-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nuts/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjusters/thread-direction~right-hand-and-left-hand/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N79&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N79%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/military-specifications-met~ms124734&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax92-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-4377/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7896753628184&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7896753628184%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/helicoils/military-specifications-met~ms124734/
2026-01-03 23:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~flammable-vapors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-pipe-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7896753628184&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7896753628184%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nuts/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-2-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpvc-pipe-strainers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjusters/thread-direction~right-hand-and-left-hand&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179265%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-228/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-4377&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-pipe-locknuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2754 pages (at 43 pages/min), scraped 57 items (at 2 items/min)
2026-01-03 23:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985661164153&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985661164153%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000145518%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-232/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~c225/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-2-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-pipe-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99015A250&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299015A250%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpvc-reducing-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-228&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-pipe-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453685%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534640%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-232&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-pipe-unions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c225-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/copper-pipe-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-handlers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-reducing-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534640%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-228&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-cylinder-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-232&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bronze-pipe-weld-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-pipe-unions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-pipe-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~2-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/head-type~t-handle/pin-type~quick-release&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-handlers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~84/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~salt-water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cylinder-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001634175%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2799 pages (at 45 pages/min), scraped 58 items (at 1 items/min)
2026-01-03 23:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~3-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-pipe-weld-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-alignment-pins/sold-as~set/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~2-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~84&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~salt-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/1922v403-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014254%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~water-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-0189/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~3-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/hole-alignment-pin-sets-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1058K18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221058K18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7909K91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227909K91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=1922v403-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/hole-alignment-pin-sets-5/
2026-01-03 23:57:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bolts/thread-size~5-16-24/
2026-01-03 23:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~5-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~0-0189&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~2-6295/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-036/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/check-valves/for-use-with~water/
2026-01-03 23:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~hr6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~0-0189/
2026-01-03 23:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2840 pages (at 41 pages/min), scraped 60 items (at 2 items/min)
2026-01-03 23:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~5-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-plates/thickness~1-2-1/thickness~0-500/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~2-6295&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-036&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~hr6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000043570%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001465708%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001465764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-plates/thickness~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-03 23:58:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/aluminum-plates/thickness~1-2
2026-01-03 23:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ribbon-cable-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-engravers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axles/diameter~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-967-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~er26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-fencing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-074&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~kaardc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~er28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~3-4-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-engravers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2884 pages (at 44 pages/min), scraped 61 items (at 1 items/min)
2026-01-03 23:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-967-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~er26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7051711979057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=helicoils&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7051711979057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-fencing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-074&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-03 23:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~kaardc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~er28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dies/thread-size~1-967-18/
2026-01-03 23:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ribbon-cable-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2435K104&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222435K104%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ridgid-141-pipe-threaders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-70-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/message~air-force/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~er40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cheek-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drums/capacity~18-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ridgid-141-pipe-threaders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~12-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~0-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axles/diameter~30-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-force-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-03 23:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~er40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~0-7-mm/
2026-01-04 00:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cheek-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity-weight-~18-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2929 pages (at 45 pages/min), scraped 62 items (at 1 items/min)
2026-01-04 00:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crank-arms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~12-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~30mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drums/capacity-weight-~18-gal-/
2026-01-04 00:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~13-16-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/material~steel-2/pin-type~clevis&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/axles/diameter~30mm/
2026-01-04 00:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axles/diameter~45-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~fz-6203-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crank-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compression-tube-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~13-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~45mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-plates/thickness~5-8-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-81/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~fz-6203-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-tube-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/axles/diameter~45mm/
2026-01-04 00:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~m2-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~1-1-4/
2026-01-04 00:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100316%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-plates/thickness~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~gya108rrb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/240l-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemical-resistant-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 2972 pages (at 43 pages/min), scraped 62 items (at 0 items/min)
2026-01-04 00:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/right-angle-drill-attachments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-81&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/aluminum-plates/thickness~5-8
2026-01-04 00:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~m2-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~2-751-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493402%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~gya108rrb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~lr9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=240l-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=right-angle-drill-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K388&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K388%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090932%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~2-751-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drums/capacity~6-1-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~lr9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~23-63/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axles/end-type~retaining-ring-groove/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-97/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009010%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002149541%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity-weight-~6-1-4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7604K931&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227604K931%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-hardness-testers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~23-63&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/end-type~with-retaining-ring-grooves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-97&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drums/capacity-weight-~6-1-4-gal-/
2026-01-04 00:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3019 pages (at 47 pages/min), scraped 63 items (at 1 items/min)
2026-01-04 00:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rigid-shaft-coupling-guards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498590%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/axles/end-type~with-retaining-ring-grooves/
2026-01-04 00:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504955%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drums/capacity~80-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-high-pressure-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-hardness-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~20-0000-mm/diameter~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~1-3-32/
2026-01-04 00:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigid-shaft-coupling-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chillers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity-weight-~80-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-high-pressure-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~b116/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-pins/certification~mil-spec/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drums/capacity-weight-~80-gal-/
2026-01-04 00:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~15-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:02:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dowel-pins/diameter~20mm/
2026-01-04 00:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/computer-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-55-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-034/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hepa-air-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=b116-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~1-5-mm/
2026-01-04 00:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crimps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/pin-type~spring/specifications-met~mil-spec-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~1-55-mm/
2026-01-04 00:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3061 pages (at 42 pages/min), scraped 64 items (at 1 items/min)
2026-01-04 00:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~15-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~10-000-mm/id~10-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r156-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-034&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plug-gauge-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562241%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496385%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs%252fpvc-sheet-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~10mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r156-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8988K44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228988K44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/plug-gauge-sets-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~10mm/
2026-01-04 00:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~16-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~5-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%227821415769809%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r166/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~27-0508-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chest-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2326A612&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222326A612%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-bit-impact-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~m12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~5-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~16-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r166&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3108 pages (at 47 pages/min), scraped 67 items (at 3 items/min)
2026-01-04 00:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~27-0508mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-release-pin-retaining-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551975%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chest-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~11-9997-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129535%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~m12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~27-0508mm/
2026-01-04 00:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551975%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~5-64&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~16-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:04:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/for-knockout-trade-size~m12/
2026-01-04 00:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/retaining-caps-for-quick-release-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drying-agents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-machine-component-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~0-028/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/abrasive-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~18-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~11-9997mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/retaining-caps-for-quick-release-pins/
2026-01-04 00:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~16-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~11-9997mm/
2026-01-04 00:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-pumps/current~3-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drying-agents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~0-028-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~18-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~18-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-machine-component-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/drive-size~0-028-1/
2026-01-04 00:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3-a-drum-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3154 pages (at 46 pages/min), scraped 67 items (at 0 items/min)
2026-01-04 00:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/screw-nails-for-metal-plastic-and-plywood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bubble-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~m63/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~18-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-075/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/screw-nails-for-metal-plastic-and-plywood/
2026-01-04 00:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562741%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bubble-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckles/attachment-type~sew-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~m63&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-188&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-075&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~pg-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/for-knockout-trade-size~m63/
2026-01-04 00:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000118628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151815%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crv3-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/attachment-type~sew-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~nic1574/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~pg-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988424212043&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988424212043%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~7-8-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckles/buckle-type~set-screw/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/for-knockout-trade-size~pg-7/
2026-01-04 00:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~nm715/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3198 pages (at 44 pages/min), scraped 70 items (at 3 items/min)
2026-01-04 00:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=29705T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2229705T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~nic1574&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103534%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~7-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/buckle-type~set-screw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081492%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~nm715&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckles/buckle-type~spring-loaded-clamp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-204&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N79&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N79%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449363%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988424212043&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988424212043%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/material~plastic/
2026-01-04 00:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522426%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckles/buckle-type~squeeze-release/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5453K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225453K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~3-248/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/buckle-type~spring-loaded-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shim-stock-sheets/material~stainless-steel-2/material~301-stainless-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chisels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A216&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A216%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckles/material~rubber-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988424212043&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988424212043%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/buckle-type~squeeze-release&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-005/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5453K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225453K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~3-248&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3246 pages (at 48 pages/min), scraped 74 items (at 4 items/min)
2026-01-04 00:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=304-stainless-steel-shim-stock-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chisels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988424212043&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988424212043%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562125%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~14-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckles/material~rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~312/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000107003%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/buckles/material~rubber/
2026-01-04 00:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-005&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5453K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225453K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-plug-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~14-1016-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cup-point-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~14-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~m11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001455791%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=312-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~16-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~14-ga/
2026-01-04 00:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5453K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225453K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-plug-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~14-1016mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cup-point-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boron-nitride-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~m11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~m26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:07:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~14-1016mm/
2026-01-04 00:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/performance~conductive-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~16-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acid-free-paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-pin-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~16-5-mm/
2026-01-04 00:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boss-hose-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~23-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3290 pages (at 44 pages/min), scraped 74 items (at 0 items/min)
2026-01-04 00:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boron-nitride-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~m26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conductive-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robot-finger-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~15-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acid-free-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boss-hose-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chrome/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~23-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acme-scaffold-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-finger-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/cable-awg~23-4/
2026-01-04 00:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chuck-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~15-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-sleeving/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chrome&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496819%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acme-scaffold-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~1-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/thread-size~3-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:02 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496819%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~15-32&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-sleeving&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3336 pages (at 46 pages/min), scraped 74 items (at 0 items/min)
2026-01-04 00:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~26-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/shape~straight/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~360j6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~1-55mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~17-01-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~no-19&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/flammability-rating~ul-2556-vw-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~1-55mm/
2026-01-04 00:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~26-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488412%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~26-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-safety-mirrors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=360j6-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~17-01mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/shape~straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/specifications-met~flame-rated-vw-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561273%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~26-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~17-01mm/
2026-01-04 00:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~2-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~no-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/conduit/specifications-met~flame-rated-vw-1/
2026-01-04 00:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-safety-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8219K68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228219K68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~18-1016-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~130-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/accordion-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9634T205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229634T205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~2-8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3380 pages (at 44 pages/min), scraped 75 items (at 1 items/min)
2026-01-04 00:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~18-1016mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diesel-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~130mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~2-8-mm/
2026-01-04 00:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/curtains/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=accordion-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/thread-size~9-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~18-1016mm/
2026-01-04 00:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~19-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~130mm/
2026-01-04 00:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~36-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acetal-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~7-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diesel-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diffusers/for-use-with~water-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2366A153&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222366A153%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~19-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~36-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499342%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/380mxl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~7-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561652%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~vacuum-lifter/manufacturer~abb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diffusers/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~166-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001462926%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3890N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223890N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/diffusers/for-use-with~water/
2026-01-04 00:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/material~acrylic-fiber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-steel-shim-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3423 pages (at 43 pages/min), scraped 77 items (at 2 items/min)
2026-01-04 00:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drain-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=380mxl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~vacuum-lifter/manufacturer~abb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/digital-calipers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~166-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~20-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3890N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223890N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/material~acrylic-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel-shim-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931321%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/fitting-type~connector-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-calipers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509730%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~20-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bulkheads/for-use-with~ethyl-alcohol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3890N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223890N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drain-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/digital-levels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~2-0625/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/type~connector&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bottles/capacity-weight-~20-ml/
2026-01-04 00:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~27-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/conduit/type~connector/
2026-01-04 00:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/for-use-with~ethyl-alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3890N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223890N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~10-50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-levels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/digital-multimeters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3467 pages (at 44 pages/min), scraped 77 items (at 0 items/min)
2026-01-04 00:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963946302057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963946302057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964443%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drain-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~27-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494794%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5713N86&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225713N86%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~27-32/
2026-01-04 00:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~2-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~10-50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wet-concrete-anchors/mount-type~weld-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-multimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-spray-containers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cords/nema-style~10-50/
2026-01-04 00:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cardboard-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-spring-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-standoffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/weld-on-stud-anchors-for-wet-concrete&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-storage-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/voltage~60v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-spray-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cardboard-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~2-75-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:12:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/weld-on-stud-anchors-for-wet-concrete/
2026-01-04 00:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-spring-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-standoffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542601%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rod-bumpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3511 pages (at 44 pages/min), scraped 78 items (at 1 items/min)
2026-01-04 00:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/voltage~60v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-125-flat-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-structural-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/batteries/voltage~60v/
2026-01-04 00:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~2-5025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-bumpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bulkheads/fitting-type~adapter-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawer-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts/fastener-strength-grade-class~astm-grade-2h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-125-flat-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-structural-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8523081672262&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8523081672262%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001570509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-5025&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carriage-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/type~adapter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawer-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8523081672262&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8523081672262%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001570509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts/fastener-strength-grade-class~astm-grade-2h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-chargers/battery-voltage~7-2v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acetal-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:13:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bulkheads/type~adapter/
2026-01-04 00:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-6799-retaining-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~1-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3553 pages (at 42 pages/min), scraped 78 items (at 0 items/min)
2026-01-04 00:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carriage-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~3-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-chargers/for-battery-voltage~7-2v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-bends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-6799-retaining-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/battery-chargers/for-battery-voltage~7-2v/
2026-01-04 00:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/voltage~25v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-55mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~3-65-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~39-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roll-benders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-u-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~3-55mm/
2026-01-04 00:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~25v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-65mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~39-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clearance-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roll-benders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~4-4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-u-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~3-65mm/
2026-01-04 00:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamps/clamp-type~band-and-buckle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bags/performance~static-dissipative-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~39-64/
2026-01-04 00:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1760N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221760N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3597 pages (at 44 pages/min), scraped 78 items (at 0 items/min)
2026-01-04 00:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumper-wheel-rollers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/confined-space-blowers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aerosil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clearance-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~4-4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps/clamp-type~band-and-buckle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/electrical-properties~static-dissipative&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/number-of-wires~41/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~4-4-mm/
2026-01-04 00:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roller-chain-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9791062983264&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9791062983264%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001938283%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3965717477234&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3965717477234%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002243614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumper-wheel-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=confined-space-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aerosil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-939-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5655K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225655K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/number-of-wires~41&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-shank-hammer-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acid-tube-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l240/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conical-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548123%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-939-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/for-use-with~liquid-nitrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9936K45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229936K45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/mounting-location~inside-corner/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acid-tube-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3639 pages (at 42 pages/min), scraped 80 items (at 2 items/min)
2026-01-04 00:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~41-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964862%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l240-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conical-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~47-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=48805K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2248805K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~6-51-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dremel-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/mounting-location~inside-corner&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~41mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l285/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~47-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-bearing-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~41mm/
2026-01-04 00:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~47-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~6-51mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~47-64/
2026-01-04 00:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hi-lok-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dremel-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1088A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221088A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~6-51mm/
2026-01-04 00:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l285-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-bearing-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-bearing-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~47mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~4-6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/an-970-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~abs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1088A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221088A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~47mm/
2026-01-04 00:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3682 pages (at 43 pages/min), scraped 82 items (at 2 items/min)
2026-01-04 00:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516891%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/garolite-sheets/material-grade~garolite-le-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/material~cork/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-bearing-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~7-015-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=an-970-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~abs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1088A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221088A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=e-glass-grade-garolite-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929784%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-sets-for-wood/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/material~cork&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~7-015mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/material~zinc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~53-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A292&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A292%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2710A56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222710A56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~7-015mm/
2026-01-04 00:17:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1088A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221088A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boxes/environment~corrosive/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bit-sets-for-wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:17:57 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/material~cork&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-end-hex-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metals/fabrication~heat-treated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~53-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boxes/environment~corrosive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~53-64/
2026-01-04 00:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3725 pages (at 43 pages/min), scraped 83 items (at 1 items/min)
2026-01-04 00:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/mount-type~hook-and-loop&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acrylic-glue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-end-hex-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metals/fabrication~heat-treated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~81-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995901722036&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995901722036%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/material~zinc&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-intensity-discharge-lamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/voltage~30v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1062337176277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1062337176277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525387%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l680/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acrylic-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~81-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~9-025-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~60-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-driven-piston-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~30v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~81-000mm/
2026-01-04 00:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l680-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acrylic-rod-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~9-025mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~60-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-driven-piston-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bumpers/thread-size~1-4-28/
2026-01-04 00:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~9-025mm/
2026-01-04 00:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~60-ga/
2026-01-04 00:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3769 pages (at 44 pages/min), scraped 84 items (at 1 items/min)
2026-01-04 00:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~30-005-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acrylic-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrosion-inhibiting-paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~nylon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~30-005mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/voltage~5v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/direct-reading-flowmeters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-inhibiting-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~30-005mm/
2026-01-04 00:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrosion-resistant-turnbuckles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930057%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-filter-sprays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=direct-reading-flowmeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~polyethylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/american-wire-gauge-awg~14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edge-grommets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-resistant-turnbuckles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/for-use-on~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/methacrylate-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3811 pages (at 42 pages/min), scraped 84 items (at 0 items/min)
2026-01-04 00:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filter-sprays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plain-bearings/plain-bearing-type~flanged-sleeve/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~polyethylene-pex-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-gauge~14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edge-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/american-wire-gauge-awg~17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckets/capacity~3-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cutters/for-use-on~polyethylene-pex-/
2026-01-04 00:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/for-use-on~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=methacrylate-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/wire-gauge~14/
2026-01-04 00:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edge-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/oil-embedded-flanged-sleeve-bearings-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/for-use-on~brass/
2026-01-04 00:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/serial-port-interface~rs-232/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose-festoon-systems/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearing-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-gauge~17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity-weight-~3-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/oil-embedded-flanged-sleeve-bearings-7/
2026-01-04 00:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edge-trim/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~neon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edge-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/wire-gauge~17/
2026-01-04 00:20:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/buckets/capacity-weight-~3-gal-/
2026-01-04 00:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope-putty/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~rs-232&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose-festoon-systems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buna-n-rubber-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/performance~metal-detectable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edge-trim&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/industry-designation~rs-232/
2026-01-04 00:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edging/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~neon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3853 pages (at 42 pages/min), scraped 84 items (at 0 items/min)
2026-01-04 00:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-putty&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope-spikes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~phosphoric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buna-n-rubber-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/finish~vinyl-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/metal-detectable-cable-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~8-1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edging/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/anchors/metal-detectable-cable-ties/
2026-01-04 00:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearing-slides/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-spikes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~phosphoric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/edging/material~stainless-steel/
2026-01-04 00:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckets/capacity~50-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/finish~vinyl-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~8-1-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/american-wire-gauge-awg~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/wire-construction~stranded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bung-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-coping-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~8-1-mm/
2026-01-04 00:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity-weight-~50-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/finish~vinyl-coated&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-particle-sensors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-type~stranded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-gauge~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/buckets/capacity-weight-~50-gal-/
2026-01-04 00:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotary-encoder-transducers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/screw-size~m3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-powered-caulk-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3896 pages (at 43 pages/min), scraped 84 items (at 0 items/min)
2026-01-04 00:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bung-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bed-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/wire-type~stranded/
2026-01-04 00:22:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/wire-gauge~8/
2026-01-04 00:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-powered-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-particle-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~9-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-encoder-transducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/for-screw-size~m3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-caulk-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bed-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casting-compound-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-crimping-tools/pipe-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/brackets/for-screw-size~m3/
2026-01-04 00:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bungs/thread-type~ngo/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~9-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/material~ceramic-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/banjo-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971791232785&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20crimping%20tools&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971791232785%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buna-n-rubber-bar-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elastic-mesh-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casting-compound-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotary-rasps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bungs/thread-type~ngo&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5548K83&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225548K83%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/material~ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/material~elastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=banjo-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buna-n-rubber-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3938 pages (at 42 pages/min), scraped 84 items (at 0 items/min)
2026-01-04 00:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elastic-mesh-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9904654906013&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9904654906013%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138997%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3m-respirator-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/material~ceramic/
2026-01-04 00:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-rasps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A648&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A648%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~1204k/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~g/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/material~elastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elastic-tie-down-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-respirator-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-temperature-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-duct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~1204k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~g&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7313N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227313N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-powered-replaceable-face-hammers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elastic-tie-down-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~100-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:23:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~g/
2026-01-04 00:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mops/mop-head-durability~disposable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-entry-grips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 3983 pages (at 45 pages/min), scraped 87 items (at 3 items/min)
2026-01-04 00:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-replaceable-face-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~100mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/number-of-wires~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-point-type~notched/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disposable-mops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/adapters/for-tube-od~100mm/
2026-01-04 00:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-temperature-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-entry-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbow-plug-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-glands/environment~sanitary/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~16002-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/number-of-wires~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/point-style~notched&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~42-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~20-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/point-style~notched/
2026-01-04 00:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~5-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbow-plug-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-glands/environment~sanitary&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~16002-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinders/body-material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K79&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K79%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6782425493977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6782425493977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~28-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~42mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002097044%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~20-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/counters/measurement-unit~inches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~5-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~42mm/
2026-01-04 00:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4028 pages (at 45 pages/min), scraped 88 items (at 1 items/min)
2026-01-04 00:25:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/air-hose/length~20-ft-/
2026-01-04 00:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~16005/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinders/body-material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6782425493977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6782425493977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinders/mounting-location~base/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~16007/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/angle-brackets/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~28mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cylinders/body-material~plastic/
2026-01-04 00:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/unit-of-measure~inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/adapters/for-tube-od~28mm/
2026-01-04 00:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~16005&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/counters/unit-of-measure~inches/
2026-01-04 00:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6782425493977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6782425493977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinders/mounting-style~base&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~16007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-combination-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-brackets/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101713%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-temperature-terminal-and-splice-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/voltage~17000v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cylinders/mounting-style~base/
2026-01-04 00:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125975%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/angle-brackets/material~plastic/
2026-01-04 00:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:25:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6782425493977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6782425493977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bench-centers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barbed-tube-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-glands/thread-size~pg-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-vent-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-combination-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~17000v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/adapters/for-tube-od~3-16/
2026-01-04 00:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/system-of-measurement~metric/material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clear-pvc-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4072 pages (at 44 pages/min), scraped 88 items (at 0 items/min)
2026-01-04 00:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bench-centers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barbed-tube-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-glands/thread-size~pg-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-vent-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3v315/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9634T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229634T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-copper-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clear-pvc-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6782425493977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6782425493977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454988%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3v335/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/round-outlet-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~42-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69915K118&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269915K118%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3v315-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~42/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/round-reflectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3v335-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-outlet-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=color-coding-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~42mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3v475/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-elbows/shape~11-1-4-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-traction-overshoes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/adapters/for-tube-od~42mm/
2026-01-04 00:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4117 pages (at 45 pages/min), scraped 90 items (at 2 items/min)
2026-01-04 00:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8511825902204&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20elbows&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8511825902204%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-reflectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/airtight-containers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cleats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3v500-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3v475-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4880K136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224880K136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5793K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225793K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/angle-grinders/power-source~air/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-vacuum-chambers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cardboard-trash-cans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=airtight-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-096/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/d-shape-knockout-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3v500-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barrel-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-grinders/power-source~air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cardboard-trash-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~7-01-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9993435663610&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9993435663610%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brakes/component~brake-disc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-096&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clevis-pins/diameter~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=d-shape-knockout-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrel-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fitting-clamps/finish~enamel-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6815449697765&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6815449697765%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000125973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4162 pages (at 45 pages/min), scraped 92 items (at 2 items/min)
2026-01-04 00:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cement/for-use-on~acrylic-plastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/wire-and-cable-use~vehicle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~7-01mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6950136306066&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fitting%20clamps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6950136306066%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6815449697765&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6815449697765%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brakes/component~brake-disc&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/for-use-with~gasoline/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clevis-pins/diameter~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~1635-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~7-01mm/
2026-01-04 00:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2663N27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222663N27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000125973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1255618309250&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1255618309250%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cement/for-use-on~acrylic-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/use-for~vehicles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fitting-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/pipe-size~5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/for-use-with~gasoline&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1255618309250&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1255618309250%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clevis-pins/diameter~1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2960338757520&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2960338757520%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~1635-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138931%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000125973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/pipe-size~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cement/for-use-on~rubber-2/for-use-on~epdm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000116800%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000125973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4207 pages (at 45 pages/min), scraped 93 items (at 1 items/min)
2026-01-04 00:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dollies/platform-style~solid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/beverage-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/system-of-measurement~m-kg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barrier-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dollies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cement/for-use-on~epdm-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/thread-type~unf/
2026-01-04 00:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4936K758&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224936K758%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clevis-slip-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3236610467807&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3236610467807%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488395%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/adapters/system-of-measurement~m-kg/
2026-01-04 00:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cement/for-use-on~epdm-rubber/
2026-01-04 00:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dollies/platform-style~solid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beverage-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-limit-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-070/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dollies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrier-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dairy-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4236684941730&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4236684941730%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clevis-slip-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dome-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ansi-40-roller-chain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-limit-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barriers/material~fabric-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-(schedule-40)-unthreaded-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-070&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dairy-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dome-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4236684941730&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4236684941730%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dome-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502218%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4249 pages (at 42 pages/min), scraped 94 items (at 1 items/min)
2026-01-04 00:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-40-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-strain-relief/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/material~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-(schedule-40)-unthreaded-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A003&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A003%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/40mxl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dome-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4236684941730&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4236684941730%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/barriers/material~fabric/
2026-01-04 00:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/for-use-with~wood-chips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-strain-relief&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/420xl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~34-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dampers/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/45-degree-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=40mxl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4236684941730&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4236684941730%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3236610467807&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3236610467807%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003490019%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-chuck-bodies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/for-use-with~wood-chips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=420xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~2211k/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dampers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dampers/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964993%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-powered-chain-hoists/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=45-degree-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/450h-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-closers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dampers/material~stainless-steel/
2026-01-04 00:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4935K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224935K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4293 pages (at 44 pages/min), scraped 95 items (at 1 items/min)
2026-01-04 00:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-1255/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~2211k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dampers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-bronze-shovels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-chain-hoists&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=450h-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-closers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~22212/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-1255&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linear-bearings/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-composite-panels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bronze-shovels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/480l-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-powered-routers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~22212&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/linear-ball-bearings-6/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-composite-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/pipe-size~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clips/finish~painted/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=480l-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-routers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4338 pages (at 45 pages/min), scraped 96 items (at 1 items/min)
2026-01-04 00:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-48-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-ball-lock-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/pem-part-number~cls-440-3/pem-part-number~s-440-3zi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/pipe-size~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-173/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/finish~painted&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ceramic-coated-linear-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-magnets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/s-style-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-48mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-ball-lock-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=s-440-3-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-173&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-coated-linear-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~0-48mm/
2026-01-04 00:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-magnets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-h-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dc-equipment-cooling-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=s-style-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~4l230/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A563&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A563%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-slotted-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/fitting-type~union-1/pipe-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-h-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-operated-cleaning-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dc-equipment-cooling-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~85-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4382 pages (at 44 pages/min), scraped 97 items (at 1 items/min)
2026-01-04 00:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4l230-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001919079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/butterfly-nuts/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-slotted-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-socket-head-cap-screw-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-biscuits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~85mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627802%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~2-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-nitride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=composite-materials&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-butterfly-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/for-shaft-diameter~85mm/
2026-01-04 00:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~130-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-socket-head-cap-screw-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/battery-size~1-2-aa/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-2031/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=biscuit-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~2-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~0-4385/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bit-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-nitride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~130-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/couplings/for-shaft-diameter~2-7-16/
2026-01-04 00:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ceramic-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-size~1-2-aa&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-213/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4423 pages (at 41 pages/min), scraped 97 items (at 0 items/min)
2026-01-04 00:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-2031&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~130-gal-/
2026-01-04 00:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/specifications-met~sae-j2494-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-4385&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/deburring-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bit-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030652%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2164N16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222164N16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-213&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/specifications-met~sae-j2494-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A098&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A098%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=deburring-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-tool-oilers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001495890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~11mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/appliance-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~3023-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2164N16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222164N16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A781&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A781%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/overall-width~11mm/
2026-01-04 00:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/black-light-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51915K125&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251915K125%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/battery-size~8d/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-tool-oilers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=appliance-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~27-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/decimal-reamers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4465 pages (at 42 pages/min), scraped 100 items (at 3 items/min)
2026-01-04 00:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3023-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2164N16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222164N16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=black-light-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/fitting-type~reducing-adapter/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-size~8d&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135164%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~9-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~27-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=decimal-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2164N16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222164N16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001589921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/type~reducing-adapter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/alcohol-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~3038-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/couplings/for-shaft-diameter~7-8/
2026-01-04 00:35:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/elbows/type~reducing-adapter/
2026-01-04 00:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/couplings/for-shaft-diameter~9-16/
2026-01-04 00:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~19-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-grip-lock-hose-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-line/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/battery-size~y50-n18l-a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000148864%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alcohol-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026147%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3038-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4511 pages (at 46 pages/min), scraped 100 items (at 0 items/min)
2026-01-04 00:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-grip-lock-hose-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092815%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-size~y50-n18l-a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-type~square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electric-drill-motors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030783%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/thread-type~npsf/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~13-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/thread-type~npsm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~1-4-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7238K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227238K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power-source~add-a-motor/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-type~square&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-drill-motors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-type~npsf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/couplings/for-shaft-type~square/
2026-01-04 00:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-type~npsm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~1-4-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=add-a-motor-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-3133/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/crowfeet/size~13-16/
2026-01-04 00:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-hose-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~1000030134-rev-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151504%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1796A23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221796A23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4555 pages (at 44 pages/min), scraped 102 items (at 2 items/min)
2026-01-04 00:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~4l890/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-3133&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blades/precision-knife-blade-type~straight-cutting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-hose-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~1000030134-rev-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/finish~brass-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-locating-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drink-mixes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101174%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4l890-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-3281/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/blade-type~general-purpose-straight-cutting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001609148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N121&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N121%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/finish~brass-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-locating-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/blades/blade-type~general-purpose-straight-cutting/
2026-01-04 00:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8304400284430&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8304400284430%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-tube-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~146881/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-row-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-3281&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drinking-water-chillers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~5-16-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504656%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~4-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4601 pages (at 46 pages/min), scraped 103 items (at 1 items/min)
2026-01-04 00:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blades/knife-blade-trade-number~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~146881&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/number-of-pieces~29/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-row-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A088&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A088%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesive-cartridges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000148004%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~20mm/
2026-01-04 00:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144167%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1530A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221530A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/trade-number~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-boxes/cable-designation~sjoow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N38&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N38%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-sided-polyethylene-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~29&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/blades/trade-number~12/
2026-01-04 00:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~3-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-boxes/cable-designation~stow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/number-of-pieces~7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-boxes/industry-designation~sjoow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-sided-polyethylene-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~6-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/electrical-boxes/industry-designation~sjoow/
2026-01-04 00:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~400-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~3-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4644 pages (at 43 pages/min), scraped 106 items (at 3 items/min)
2026-01-04 00:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-boxes/industry-designation~stow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065801%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dewalt-cordless-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-065/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~7-1-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~3-2mm/
2026-01-04 00:39:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/electrical-boxes/industry-designation~stow/
2026-01-04 00:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1530A52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221530A52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001555292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l355/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cap-screws/military-specification~army-navy-specification/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~400-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dewalt-cordless-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-065&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~7-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~400-gal-/
2026-01-04 00:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/alumina-silicate-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concealed-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/overall-width~7-1-8/
2026-01-04 00:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~60-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l355-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=army-navy-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-128/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dow-corning-molykote-3452-grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~cast-iron/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alumina-silicate-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blind-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~5-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-push-button-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~60-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~300-03866/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-128&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4686 pages (at 42 pages/min), scraped 107 items (at 1 items/min)
2026-01-04 00:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-molykote-3452-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chain/roller-chain-trade-size~60-4/
2026-01-04 00:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~cast-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~4-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000120851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blind-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~5-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/anhydrous-ammonia-labels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-push-button-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~300-03866&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicator-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~5-gal-/
2026-01-04 00:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~4-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calibration-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anhydrous-ammonia-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sandpaper-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/articulating-arms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N98&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N98%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~4-6mm/
2026-01-04 00:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicator-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concrete-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicator-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calibration-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~4-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-501/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=articulating-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4730 pages (at 44 pages/min), scraped 108 items (at 1 items/min)
2026-01-04 00:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m160/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/13-chain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-cord-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicator-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~4-9mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/asbestos-stickers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l630/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-501&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m160&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~4-9mm/
2026-01-04 00:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/trade-size~13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum/material~aluminum-2/material~6101-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cord-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m2-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chain/trade-size~13/
2026-01-04 00:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ansi-flared-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=asbestos-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l630-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~propylene-glycol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~plaster/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/material~aluminum/material~6101-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m2-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ansi-shaft-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-flared-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4770 pages (at 40 pages/min), scraped 108 items (at 0 items/min)
2026-01-04 00:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5069306377488&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5069306377488%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512093%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/material~aluminum-2/pressure-class~150/fitting-connection~threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=condensate-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~propylene-glycol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~plaster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanitary-napkin-receptacle-liners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-shaft-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~5-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~75-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3319N135&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223319N135%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/material~aluminum-2/thread-type~bspp/thread-type~bspt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-napkin-receptacle-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~21eza199/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000037076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~5-9mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~75-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~sulfur-tetrafluoride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/range-of-motion~95&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~5-9mm/
2026-01-04 00:43:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~75-ml/
2026-01-04 00:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~21eza199&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wipes/material~microfiber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/coatings/for-use-on~fiberglass/
2026-01-04 00:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4818 pages (at 48 pages/min), scraped 109 items (at 1 items/min)
2026-01-04 00:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6204-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~25-441j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078073%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~sulfur-tetrafluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6204-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~25-441j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=microfiber-wipes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~28-0-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~leather&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133391%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/adhesives/for-use-on~steel/
2026-01-04 00:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/coatings/for-use-on~leather/
2026-01-04 00:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6205-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-441/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~28-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/manufacturer-model-number~26-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6206/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~14-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~7-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~28-mm/
2026-01-04 00:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4860 pages (at 42 pages/min), scraped 110 items (at 1 items/min)
2026-01-04 00:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6205-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/micrometer-stages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-441&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~26-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6206&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~14-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5v1180/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091299%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/manufacturer-model-number~500-171-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117978%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/drive-size~14-mm-1/
2026-01-04 00:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hitch-pin-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micrometer-stages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-hazard-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5v1180-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~4-0-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/antislip-roller-wrap-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~500-171-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117978%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~513-405-10t/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-6562&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002149696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-hazard-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~0-6562/
2026-01-04 00:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/number-of-poles~25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antislip-roller-wrap-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117978%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4907 pages (at 47 pages/min), scraped 110 items (at 0 items/min)
2026-01-04 00:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-splitters/electrical-connection~coaxial/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-405-10t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~4-mm/
2026-01-04 00:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hmi-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1712501638756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire%20connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1712501638756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/pipe-size~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1829K332&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221829K332%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117978%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolt-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coaxial-cable-splitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/pipe-size~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/pipe-size~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/astm-b21-brass/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136829%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-valves/fitting-connection~butt-weld/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shape~90-elbow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolt-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/number-of-poles~9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coiled-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1712501638756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire%20connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1712501638756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536838%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-b21-brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/converters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butt-weld-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~74-105997/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-guns/welding-process~mig/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shape~90-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69295K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269295K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coiled-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4951 pages (at 44 pages/min), scraped 111 items (at 1 items/min)
2026-01-04 00:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~loctite/manufacturer-model-number~549/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=converters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mig-welding-supplies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~loctite/manufacturer-model-number~5570/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~74-105997&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-welding-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69295K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269295K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~40-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite-/manufacturer-model-number~549&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5vx730/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~19-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-welding-supplies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite-/manufacturer-model-number~5570&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083694%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~a93/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69295K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269295K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~40-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088092%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/arbors/for-holding~grinding-cones/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5vx730-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~19-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~40-2/
2026-01-04 00:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6430A798&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226430A798%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083694%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scaffolding-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~a93&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69295K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269295K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:47:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~19-32/
2026-01-04 00:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-087/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 4997 pages (at 46 pages/min), scraped 112 items (at 1 items/min)
2026-01-04 00:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arbors/for-holding~grinding-cones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~105-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/manufacturer-model-number~798b-12-300/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-legs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083694%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4531265455181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4531265455181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7697K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227697K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scaffolding-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-087&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cutting-crimpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~105mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~798b-12-300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-legs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083694%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4531265455181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4531265455181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~105mm/
2026-01-04 00:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092828%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/arkansas-stones/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-087&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-ring-terminals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/butyl-rubber-sheet-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/specifications-met~astm-a126&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4531265455181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4531265455181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/specifications-met~astm-a181&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arkansas-stones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-ring-terminals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135393%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5045 pages (at 48 pages/min), scraped 113 items (at 1 items/min)
2026-01-04 00:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connector-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butyl-rubber-sheet-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6801-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4531265455181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4531265455181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12555K79&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212555K79%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-chain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-switch-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scoop-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~13-051-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6801-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~br2032/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~2-1-4-4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-switch-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148659%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scoop-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~13-051mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:48:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/couplings/thread-size~2-1-4-4-1-2/
2026-01-04 00:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-003/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~13-051mm/
2026-01-04 00:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~13-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~br2032&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mil-spec-cable-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx173/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5088 pages (at 43 pages/min), scraped 114 items (at 1 items/min)
2026-01-04 00:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjustable-height-tables/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/breakers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-003&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~citric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~e14-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~13-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K751&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K751%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-spec-cable-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx173-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-height-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-1253/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K751&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K751%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/square-drive-size~5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct/component~duplex-receptacle-outlet-box-cover/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~4-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/measures~inside/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-063/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~e20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-grids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1253&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K751&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K751%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/square-drive-size~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~duplex-receptacle-outlet-box-cover&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/measures~inside-measurement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5136 pages (at 48 pages/min), scraped 114 items (at 0 items/min)
2026-01-04 00:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-063&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550030%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000153987%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/calipers/measures~inside-measurement/
2026-01-04 00:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjustable-pressure-relief-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497135%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550030%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1253&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:50:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K751&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K751%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53055A103&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253055A103%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71865K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271865K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~15-0508-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mil-spec-hex-head-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-pressure-relief-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-wire-crimping-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53055A103&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253055A103%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-0508mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-spec-hex-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:50:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~15-0508mm/
2026-01-04 00:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~cr2477n/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wire-crimping-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53055A103&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253055A103%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497832%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087571%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-extrusion-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5181 pages (at 45 pages/min), scraped 115 items (at 1 items/min)
2026-01-04 00:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax103/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~cr2477n&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-126/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53055A103&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253055A103%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/specifications-met~mss-sp-97&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mil-spec-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-extrusion-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax103-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fencing/fencing-component~barbed-wire-support-for-support-posts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-e84-5%252f15-polyethylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K874&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K874%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-126&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4565T311&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224565T311%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/automotive-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-spec-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/automatic-oilers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fencing/component~barbed-wire-support-for-support-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axial-nut-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=container-door-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~10-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/thread-type~unf-1/pipe-size~3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/material~cardboard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=automatic-oilers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=automotive-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078531%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/milling-toggle-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511131%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5228 pages (at 47 pages/min), scraped 117 items (at 2 items/min)
2026-01-04 00:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-grade-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axial-nut-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/thread-type~unf/pipe-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=milling-toggle-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fencing/component~barbed-wire-support-for-support-posts/
2026-01-04 00:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~29-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-grade-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bakery-cart-shrouds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-nut-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=convex-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~ip5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-pulling-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~29-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~union-1/pipe-size~1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/miniature-brass-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bakery-cart-shrouds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/hole-diameter~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/size~29-mm/
2026-01-04 00:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/milwaukee-band-saws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~ip5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/borosilicate-glass-rods-and-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001669914%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/pipe-size~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-brass-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~ip5/
2026-01-04 00:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5274 pages (at 46 pages/min), scraped 117 items (at 0 items/min)
2026-01-04 00:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~t1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-lacing/lacing-number~ucm36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass/borosilicate-glass-rods-and-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=milwaukee-band-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-lacing/lacing-number~ucm36sp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6363923171247&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6363923171247%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073176%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/glass/borosilicate-glass-rods-and-discs/
2026-01-04 00:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6363923171247&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6363923171247%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039425%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings-for-hydraulic-fluid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~t1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings-for-hydrochloric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6164K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226164K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/for-use-on~plastic-1/for-use-on~peek/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6164K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226164K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~t1/
2026-01-04 00:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings-for-nitrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-hoists&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/miniature-gas-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-flange-aligners/aligner-connection-method~screw-together&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/miniature-louvers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6164K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226164K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~peek-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/band-saw-blade-coil-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9854076438018&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20flange%20aligners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9854076438018%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380195%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/glue/for-use-on~peek-plastic/
2026-01-04 00:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scribers/tip-style~flat/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-gas-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5324 pages (at 50 pages/min), scraped 118 items (at 1 items/min)
2026-01-04 00:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-louvers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/hole-diameter~41-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6164K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226164K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=band-saw-blade-coil-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotary-hammers/for-bit-shank-type~sds-max/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~t15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002269672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scribers/tip-style~flat&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/hole-diameter~7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sds-max-shank-masonry-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gum-rubber-balls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6164K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226164K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8496026489774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8496026489774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002239703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001669907%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sds-max-rotary-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~t15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002269672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sds-max-shank-masonry-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-snap-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/size~t15/
2026-01-04 00:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gum-rubber-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/socket-shape~4-point&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8496026489774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8496026489774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002239703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001669907%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seaming-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002269672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hollow-pin-roller-chain-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5371 pages (at 47 pages/min), scraped 118 items (at 0 items/min)
2026-01-04 00:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5543A14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225543A14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8496026489774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8496026489774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002239703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-gaskets/pipe-size~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001669907%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seaming-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-hose-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002269672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-dispensers/coolant-dispenser-type~mist&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-gaskets/pipe-size~24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3828206583512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=coolant%20dispensers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3828206583512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002255963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5543A14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225543A14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8496026489774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8496026489774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002239703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-gaskets/for-pipe-size~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001669907%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barrier-free-door-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-gaskets/for-pipe-size~12/
2026-01-04 00:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-gaskets/for-pipe-size~24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-straps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-gaskets/material~buna-n&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3828206583512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=coolant%20dispensers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3828206583512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002255963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-chargers-and-starters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5543A14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225543A14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-gaskets/pipe-size~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:55:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-gaskets/for-pipe-size~24/
2026-01-04 00:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9811964018420&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9811964018420%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrier-free-door-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9811964018420&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9811964018420%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:11 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9811964018420&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9811964018420%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-gaskets/material~buna-n&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 00:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5424 pages (at 53 pages/min), scraped 118 items (at 0 items/min)
2026-01-04 00:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3828206583512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=coolant%20dispensers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3828206583512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002255963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-chargers-and-starters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5543A14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225543A14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:56:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~4/
2026-01-04 00:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/environment~submersible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-hangers/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-dip-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hook-racks/mount-type~magnetic-back/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3111105495877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cord%20grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3111105495877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/service-drop-grips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3828206583512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=coolant%20dispensers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3828206583512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002255963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~t6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-dust-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-terminals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-hangers/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mixers/for-use-with~dairy/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-racks/mount-type~magnetic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-terminal-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=service-drop-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-hangers/material~aluminum/
2026-01-04 00:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~t6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wireless-receivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mixers/for-use-with~oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998716923991&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hook%20racks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998716923991%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-terminal-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~t6/
2026-01-04 00:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/for-use-with~dairy&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-terminal-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-insulation-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aspirin/manufacturer-brand~bayer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5470 pages (at 46 pages/min), scraped 118 items (at 0 items/min)
2026-01-04 00:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8018988495419&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8018988495419%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964932%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/for-use-with~oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sewer-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-terminal-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8018988495419&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8018988495419%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-pump-liquid-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/diameter~2-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bayer-aspirin&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mixing-buckets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sewer-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/beam-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~12v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shaft-support-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553683%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sheet-gasket-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~2-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixing-buckets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-locknuts/pipe-size~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beam-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-support-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001538326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity~18-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/diameter~7-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4957971726222&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20locknuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4957971726222%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheet-gasket-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3968674775186&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drums&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3968674775186%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135431%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4464K592&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224464K592%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shell-milling-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5518 pages (at 48 pages/min), scraped 118 items (at 0 items/min)
2026-01-04 00:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shelving-pegs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~37-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~7-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drums/capacity~17-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iso-16b-roller-chain-links/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497860%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518530%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~organic-vapors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shell-milling-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shelving-pegs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4002A113&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224002A113%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/environment~dusty&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity-weight-~17-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-16b-roller-chain-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5519429302621&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=counters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5519429302621%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jackets/color~fluorescent-orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bench-grinder-safety-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6820N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226820N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drums/capacity-weight-~17-gal-/
2026-01-04 00:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bench-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4002A113&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224002A113%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-069/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lags/thread-size~m10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/color~fluorescent-orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bench-grinder-safety-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/screw-size~no-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bench-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4002A113&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224002A113%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5565 pages (at 47 pages/min), scraped 121 items (at 3 items/min)
2026-01-04 00:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/for-use-on~stainless-steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wood%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-069inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lags/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shop-vac-905-03-vacuum-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8325T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228325T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=983458193638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=countersinks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B983458193638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929868%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-069inches/
2026-01-04 00:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9974560404121&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9974560404121%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4002A113&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224002A113%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 00:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shop-vac-vacuum-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/material~p22-chrome-moly-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shop-vac-905-03-vacuum-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8325T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228325T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-124/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dry-erase-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/pipe-size~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511897%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shop-vac-vacuum-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dry-level-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8325T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228325T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1982K27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221982K27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-124inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 00:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-thread-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wooden-dowel-drill-jigs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-124inches/
2026-01-04 01:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8325T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228325T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-use-on~air-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~12-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5614 pages (at 49 pages/min), scraped 122 items (at 1 items/min)
2026-01-04 01:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-168/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-thread-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-use-on~bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dry-running-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-use-on~close-fitting-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/specifications-met~astm-d1784&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-use-on~air-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~12mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090887%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-168inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-189/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-use-on~bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/molly-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929629%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-shaft-diameter~12mm/
2026-01-04 01:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cordsets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-use-on~close-fitting-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-168inches/
2026-01-04 01:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-189inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=molly-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/pipe-size~1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dual-line-air-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-189inches/
2026-01-04 01:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dual-snaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000156884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/signal-conditioning-relays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/momentary-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~1-1-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/pipe-size~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/pipe-schedule~80&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5664 pages (at 50 pages/min), scraped 122 items (at 0 items/min)
2026-01-04 01:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-257/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=signal-conditioning-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-251&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=momentary-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicone-rubber-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~kroil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-257inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~krytox-1514/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K358&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K358%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-257inches/
2026-01-04 01:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~horizontal-tee&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~kroil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-335&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-rubber-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~krytox-1514&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002261998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/specifications-met~fed-spec-qq-a-200-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=30065T321&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2230065T321%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/specifications-met~iso-1179&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1463K134&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221463K134%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128260%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151071%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5715 pages (at 51 pages/min), scraped 125 items (at 3 items/min)
2026-01-04 01:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~krytox-gpl-207/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3867T361&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223867T361%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/specifications-met~iso-6149&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4936K916&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224936K916%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~krytox-gpl-226/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~lb-771-nickel-grade-anti-seize/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106365%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/monitors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~krytox-gpl-207&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4936K675&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224936K675%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104686%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~krytox-gpl-226&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~lb-771-nickel-grade-anti-seize&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-385&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=monitors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4936K675&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224936K675%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-385/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blind-rivet-gun-replacement-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K756&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K756%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blind-rivet-stud-snaps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~lubriplate-no-130-a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4936K675&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224936K675%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5761 pages (at 46 pages/min), scraped 129 items (at 4 items/min)
2026-01-04 01:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-385inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blind-rivet-gun-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=woven-wire-partitions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-385inches/
2026-01-04 01:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blind-rivet-stud-snaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/skived-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~lubriplate-no-130-a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4936K675&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224936K675%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sledge-hammer-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129252%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cordsets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-745/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=skived-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2289N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222289N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=current-to-pressure-transducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sledge-hammer-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slide-hammer-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-745inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/motor-overloads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/motor-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-solder&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-745inches/
2026-01-04 01:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slide-hammer-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~molykote-44-medium-high-temperature/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-811&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-936-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5806 pages (at 45 pages/min), scraped 130 items (at 1 items/min)
2026-01-04 01:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motor-overloads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/motor-shaft-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-support-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motor-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~molykote-44-medium-high-temperature&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8967K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228967K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8967K91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228967K91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cushions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motor-shaft-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-airflow-flaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-ball-joints/duct-size~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121247%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~synxtreme-hd-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/motors/motor-frame-size~nema-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5434433323374&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20ball%20joints&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5434433323374%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002013718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~1-39/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~tin&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/drive-size~3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~particleboard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:59 [scrapy.core.downloader.handlers.http11] (PID: 126) WARNING: Got data loss in https://www.mcmaster.com/slip-ring-connectors. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests
2026-01-04 01:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~synxtreme-hd-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/slip-ring-connectors already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~velocite-no-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motors/motor-frame-size~nema-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003229290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489988%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089241%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~1-39inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9884332045743&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9884332045743%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001574040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5856 pages (at 50 pages/min), scraped 132 items (at 2 items/min)
2026-01-04 01:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1821A77&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221821A77%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~1-39inches/
2026-01-04 01:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~velocite-no-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:17 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9884332045743&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9884332045743%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001574040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motors/motor-frame-size~nema-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/smart-relays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boron-carbide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1252K27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221252K27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~wd-40-specialist-silicone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slip-ring-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=smart-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cycle-timer-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boron-carbide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~wd-40-specialist-silicone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/melamine-foam-insulation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slip-ring-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boring-bar-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinder-clevis-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bounce-back-guard-posts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mounting-feet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/smooth-surface-light-diffusers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=melamine-foam-insulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mounting-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~1-8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boring-bar-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-clevis-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bounce-back-guard-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mounting-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494360%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5901 pages (at 45 pages/min), scraped 135 items (at 3 items/min)
2026-01-04 01:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=smooth-surface-light-diffusers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/snap-loc-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mounting-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/snap-toggles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50315K21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250315K21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pinch-clamp-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-loc-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-fittings/material~pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~2-245/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-grilles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=d-profile-precision-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-toggles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/pinch-clamp-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8654208980817&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8654208980817%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510407%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-hose/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~no-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/brackets/pinch-clamp-pliers/
2026-01-04 01:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~2-245inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8654208980817&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8654208980817%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510407%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-fittings/material~pvc&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-122128-helical-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brake-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8707661853867&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8707661853867%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-hose/flammability-rating~nfpa-90b/flammability-rating~nfpa-90a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-spinner-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~2-245inches/
2026-01-04 01:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder-joint-tube-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/drive-size~no-12-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8707661853867&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8707661853867%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362089%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364730%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 5949 pages (at 48 pages/min), scraped 136 items (at 1 items/min)
2026-01-04 01:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-124709-helical-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~2-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-122128-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brake-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8707661853867&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8707661853867%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/drive-size~no-12-1/
2026-01-04 01:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5501K81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225501K81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-spinner-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-joint-tube-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-124709-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/breakaway-collar-removal-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50405K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250405K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8707661853867&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8707661853867%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~t9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/drive-size~t8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=deburring-wheel-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakaway-collar-removal-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8707661853867&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8707661853867%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/od~1-13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/drive-size~t9-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=desiccants/food-industry-standard~fda-compliant-21-cfr-172-230&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-ball-joint-rod-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162589%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/drive-size~t9-1/
2026-01-04 01:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sound-baffles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ductile-cast-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3068903585281&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=desiccants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3068903585281%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005072433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/specifications-met~sae-ams3195/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6003 pages (at 54 pages/min), scraped 138 items (at 2 items/min)
2026-01-04 01:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~0-035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-clamp-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:18 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3068903585281&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=desiccants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3068903585281%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005072433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=desiccants/food-industry-standard~fda-compliant-21-cfr-172-230&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/specifications-met~sae-ams3301/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/specifications-met~sae-ams3320/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ductwork/fitting-connection~quick-disconnect-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~0-141/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sound-baffles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/specifications-met~sae-ams3195&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1612888469094&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ductwork&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1612888469094%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003411191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~0-035inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bucket-liners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dunnage-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/specifications-met~sae-ams3301&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/specifications-met~sae-ams3320&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~0-035inches/
2026-01-04 01:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~0-141inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~13-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1059N358&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221059N358%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091042%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:08:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~0-141inches/
2026-01-04 01:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~3-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bucket-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:01 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/specifications-met~sae-ams3301&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8612K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228612K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~0-40625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1059N358&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221059N358%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6045 pages (at 42 pages/min), scraped 138 items (at 0 items/min)
2026-01-04 01:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~0-40625inches/
2026-01-04 01:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~0-75inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~0-9375inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-16996-2-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=durometer-hardness-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~0-75inches/
2026-01-04 01:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~1-25inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1059N358&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221059N358%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=durometer-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~0-9375inches/
2026-01-04 01:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fitting-band-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-compression-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~1-25inches/
2026-01-04 01:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~nitrogen-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16996-2-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bull-points/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-collector-hoods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1059N358&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221059N358%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval-number~tc-84a-0120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval-number~tc-84a-3002/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-trash-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~nitrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bull-points&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~3millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/fitting-connection~barbed-2/for-use-with~butane-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-masks/niosh-approval~tc-84a-0120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose-fittings/connection-style~barbed/for-use-with~nitrogen/
2026-01-04 01:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-masks/niosh-approval~tc-84a-3002&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6093 pages (at 48 pages/min), scraped 139 items (at 1 items/min)
2026-01-04 01:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-indicator-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~3millimeters/
2026-01-04 01:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964626%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dust-masks/niosh-approval~tc-84a-0120/
2026-01-04 01:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bus-bar-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-trash-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dust-masks/niosh-approval~tc-84a-3002/
2026-01-04 01:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-7991-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval~tc-84a-1459/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyester-(petg)/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-end-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-voltmeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bus-bar-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/military-specification~ms20470ad5-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-fuel-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-7991-a2-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester-(petg)&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~no-14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-20470-ad5-6-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~no-26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/output-voltage~36v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dye-tablets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diodes/electronic-component-trade-number~1-5ke15a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-hex-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~no-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hold-open-hinges/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6138 pages (at 45 pages/min), scraped 139 items (at 0 items/min)
2026-01-04 01:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~no-26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~no-14/
2026-01-04 01:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/garolite-sheets/material-grade~garolite-le-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/output-voltage~36v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diodes/electrical-component-trade-number~1-5ke15a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/voltage~5v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~no-26/
2026-01-04 01:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bx-cable-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5598907428381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5598907428381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001632436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/diodes/electrical-component-trade-number~1-5ke15a/
2026-01-04 01:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval~tc-84a-1459/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diodes/electronic-component-trade-number~1-5ke6-8a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-hold-open-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-insulation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lacquers/container-type~aerosol-can/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7010K168&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227010K168%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/voltage~5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx-cable-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diodes/electronic-component-trade-number~1n4148/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5598907428381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5598907428381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-nozzle-swivel-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diodes/electrical-component-trade-number~1-5ke6-8a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-insulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval-number~tc-84a-1459/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cabinet-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-lacquers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:11:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/diodes/electrical-component-trade-number~1-5ke6-8a/
2026-01-04 01:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diodes/electrical-component-trade-number~1n4148&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diodes/electronic-component-trade-number~1n4737a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stick-electrodes/aws-material-code~e308l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-nozzle-swivel-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cabinet-screwdrivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=100xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/diodes/electrical-component-trade-number~1n4148/
2026-01-04 01:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6180 pages (at 42 pages/min), scraped 140 items (at 1 items/min)
2026-01-04 01:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-masks/niosh-approval~tc-84a-1459&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=128mxl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diodes/electrical-component-trade-number~1n4737a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=e308l-stick-electrodes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dust-masks/niosh-approval~tc-84a-1459/
2026-01-04 01:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hospital-grade-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-fingers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/diodes/electrical-component-trade-number~1n4737a/
2026-01-04 01:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/square-drive-size~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diodes/electronic-component-trade-number~1n5817/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=140xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concrete-mixing-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mop-pails/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000046121%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-fingers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hot-melt-glue-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000046121%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/square-drive-size~5-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diodes/electrical-component-trade-number~1n5817&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=earplugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=easy-fit-barbed-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-mixing-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-mop-pails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/diodes/electrical-component-trade-number~1n5817/
2026-01-04 01:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dipping-baskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6231 pages (at 51 pages/min), scraped 140 items (at 0 items/min)
2026-01-04 01:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24671-40-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-tempered-bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=direct-acting-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wyes/fitting-connection~threaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrot-copper-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=easy-view-oil-level-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~1-1-8-to-2-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eaton-snap-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disconnect-switches/switching-current~30-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24671-40-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-tempered-bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wyes/connection-style~threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calibration-solutions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5716559981042&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=disconnect%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5716559981042%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ed23-1%252f2-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/for-shaft-diameter~1-1-8-to-2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wyes/connection-style~threaded/
2026-01-04 01:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24693-c30-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1960N4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221960N4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wyes/pipe-size~2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sprockets/for-shaft-diameter~1-1-8-to-2-1-2/
2026-01-04 01:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-cone-sems-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calibration-solutions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984228142725&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wyes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984228142725%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104826%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-push-to-connect-tube-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-cone-sems-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=humidity-data-loggers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24693-c73-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c30-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6278 pages (at 47 pages/min), scraped 141 items (at 1 items/min)
2026-01-04 01:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-cone-sems-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-27183-43-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-rubber-duct-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms27183-48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-cone-sems-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c73-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=document-organizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/canes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydlar-z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-27183-43-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squirter-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3d-printer-filaments/performance~static-dissipative-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-27183-48-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/canton-flannel-buffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=canes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/canvas-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cap-nut-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squirter-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/performance~static-control-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/material~plastic-1/material~ldpe-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=y-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6323 pages (at 45 pages/min), scraped 141 items (at 0 items/min)
2026-01-04 01:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=canton-flannel-buffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8230254771998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20filaments&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8230254771998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005316687%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=canvas-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nut-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-dampers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-jack-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/material~plastic/material~ldpe-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-35275-243-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-drafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=yoke-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plastic-sheets/material~plastic/material~ldpe-plastic/
2026-01-04 01:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=yoke-track-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carabiners-for-fall-arrest-lifelines/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edging&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edm-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=effluent-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-35335-59-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35275-243-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-dioxide-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=egg-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carabiners-for-fall-arrest-lifelines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stake-trucks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-35649-244-machine-screw-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-reservoirs/flow-control-type~fixed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stand-up-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35335-59-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6371 pages (at 48 pages/min), scraped 141 items (at 0 items/min)
2026-01-04 01:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-dioxide-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=z-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-steel-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stake-trucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35649-244-machine-screw-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-reservoirs/flow-control~fixed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stand-up-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standard-nfpa-valve-mounting-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carburetor-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=68mxl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hydraulic-reservoirs/flow-control~fixed/
2026-01-04 01:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/card-reader-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoff-hangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-nfpa-valve-mounting-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carburetor-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elastic-tie-tag-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=card-reader-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-trucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-track-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoff-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carpet-saddles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-tube-benders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51023-60-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6421 pages (at 50 pages/min), scraped 141 items (at 0 items/min)
2026-01-04 01:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carrying-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-corrosion-inhibiting-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-winch-tuggers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/abrading-and-polishing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-ingots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carpet-saddles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51023-60-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-barbed-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carrying-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carton-staplers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-barbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrading-polishing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/thickness~0-008&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrading-polishing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/static-control-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carton-staplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastic%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001460409%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrading-polishing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrading-polishing&srchtxt=&mixedworld=force&workstationdata=true> (failed 3 times): 500 Internal Server Error
2026-01-04 01:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-sealed-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:06 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <500 https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrading-polishing&srchtxt=&mixedworld=force&workstationdata=true>: HTTP status code is not handled or not allowed
2026-01-04 01:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/fitting-connection~quick-disconnect/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-flat-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caster-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6468 pages (at 47 pages/min), scraped 141 items (at 0 items/min)
2026-01-04 01:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51575-9-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51576-4-shoulder-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=i-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51957-16-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caster-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/connection-style~quick-disconnect&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=draft-blockers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casting-wax/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614592%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/connection-style~quick-disconnect/
2026-01-04 01:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51576-4-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/catch-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51957-16-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~16-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614592%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~1-1-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caulk-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casting-wax&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=catch-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~16-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6515 pages (at 47 pages/min), scraped 141 items (at 0 items/min)
2026-01-04 01:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=idler-pulleys/belt-type~v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=draw-clasps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iec-c13-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~23-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caulk-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/zip-ties/length~16-ft-/
2026-01-04 01:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5480870255646&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=idler%20pulleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5480870255646%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924236%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51957-8-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=illuminated-loupe-eyeglass-magnifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612247%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/overall-length~3-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/for-use-with~sodium-carbonate-soda-ash/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steering-wheel-lockouts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawer-slides/material~steel-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dock-lights/light-technology~incandescent/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~78/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~3-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/for-use-with~sodium-carbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=in-circuit-test-probes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stack-lights/bulb-type~incandescent/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9864611406106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawer%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9864611406106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bit-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steering-wheel-lockouts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001610029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/for-use-with~sodium-carbonate/
2026-01-04 01:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51957-8-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=incandescent-dock-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~6-1-2-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:05 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001610029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~3-5-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51959-31-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=incandescent-stack-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6562 pages (at 47 pages/min), scraped 141 items (at 0 items/min)
2026-01-04 01:20:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/zip-ties/length~6-1-2-ft-/
2026-01-04 01:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ceramic-casting-compounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=incline-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/pipe-size~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51959-31-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cga-580-welding-gas-regulators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-casting-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=index-card-dividers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/for-use-on~copper-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/pipe-size~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=elbows&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adapters/for-tube-od~5-16/
2026-01-04 01:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-tweezers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45735K613&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245735K613%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-enlarging-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stop-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-580-welding-gas-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/military-specification~ms20822-6-6j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~1-1-2-6-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51967-6-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45735K613&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245735K613%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/hole-enlarging-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stop-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/specifications-met~ms20822-6-6j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6610 pages (at 48 pages/min), scraped 141 items (at 0 items/min)
2026-01-04 01:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/specifications-met~national-standard-plumbing-code-compliant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-welding-fillers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/hole-enlarging-drill-bits/
2026-01-04 01:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~wastewater-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/specifications-met~ms20822-6-6j/
2026-01-04 01:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51967-6-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=elbows&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45735K613&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245735K613%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straightedge-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-link-fence-privacy-slats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-link-fence-privacy-screens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-repair-links/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5035K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225035K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strapping-carts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~wastewater-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastics/color~off-white-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45735K613&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245735K613%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straightedge-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-link-fence-privacy-slats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-link-fence-privacy-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-repair-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/propane/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strapping-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastics/color~white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastics/color~off-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-dispensing-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/msds-binders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastics/material~plastic-1/material~eva/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=778212328374&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B778212328374%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plastics/color~off-white/
2026-01-04 01:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6655 pages (at 45 pages/min), scraped 142 items (at 1 items/min)
2026-01-04 01:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/proportioning-drum-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=propane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/tube-od~1-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/propylene-gas/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=msds-binders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/protective-barrier-hand-cream/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastics/material~plastic/material~eva-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/tube-od~13-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=proportioning-drum-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strip-door-mounting-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plastics/material~plastic/material~eva-plastic/
2026-01-04 01:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002217064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=injectable-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5194K411&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225194K411%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=propylene-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electric-gearmotors/motor-enclosure-type~totally-enclosed-nonventilated-tenv/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=protective-barrier-hand-cream&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3636N19&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223636N19%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strip-door-mounting-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/protective-edging/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-gearmotors/mounting-location~base&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/multifunction-relays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-gearmotors/motor-enclosure-type~totally-enclosed-nonventilated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/tube-od~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cherry-pickers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-gearmotors/voltage~230v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/electric-gearmotors/motor-enclosure-type~totally-enclosed-nonventilated/
2026-01-04 01:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6703 pages (at 48 pages/min), scraped 144 items (at 2 items/min)
2026-01-04 01:23:13 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-gearmotors/mounting-location~base&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=protective-edging&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastics/thickness~3-000-mm/thickness~3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001472289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multifunction-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastisol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/faucet-repair-kits/for-manufacturer~chicago-faucet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553713%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strut-channel-shelving-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=778212328374&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B778212328374%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001465555%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464847%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cherry-pickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553713%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-gearmotors/voltage~230v-ac&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2656T64&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222656T64%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chloride-test-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chicago-faucet-faucet-repair-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strut-channel-shelving-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-insulation-jacketing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chlorine-probes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inox-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-motors/mounting-position~horizontal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ptfe-coated-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4889881527474&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4889881527474%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126689%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chloride-test-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adhesives/for-use-on~plastic/
2026-01-04 01:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nail-set-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chlorine-probes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6750 pages (at 47 pages/min), scraped 145 items (at 1 items/min)
2026-01-04 01:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite/manufacturer-model-number~088&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/name-badge-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plates/material~aluminum-2/material~5052-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/nut-type~screw-mount&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ptfe-coated-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chuck-jaws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002242151%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143624%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511972%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165946%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nail-set-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-torque-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=name-badge-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/naphtha/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-jaws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/narrow-jaw-vises/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511972%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas-1149-cn816r-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-boxes/cable-designation~seow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circle-lasers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=platforms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~loctite/manufacturer-model-number~pc-6231/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=naphtha&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=narrow-jaw-vises&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511972%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1149-cn816r-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-boxes/industry-designation~seow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circle-lasers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6799 pages (at 49 pages/min), scraped 145 items (at 0 items/min)
2026-01-04 01:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite-/manufacturer-model-number~pc-6231&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/electrical-boxes/industry-designation~seow/
2026-01-04 01:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pull-cables/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511972%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timer-relays/socket-connection~circular-pin-terminal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circular-saw-blade-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-boxes/shape~rectangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swing-cylinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-type~unjf-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1660N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221660N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9258992769719&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9258992769719%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-cables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002393853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-pin-timing-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-saw-blade-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swing-cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1351c-5-12-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switch-mat-controllers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switch-type~air-actuated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pull-quick-release-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plug-gauge-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6844 pages (at 45 pages/min), scraped 146 items (at 1 items/min)
2026-01-04 01:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~12-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1351c-5-12-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switch-mat-controllers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plug-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~14-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switch-type~air-actuated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-008&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005163136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002243839%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-014&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-quick-release-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulley-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K88&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K88%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clean-room-stairs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6452T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226452T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7695K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227695K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K646&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K646%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~16-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-card-racks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K623&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K623%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clean-room-stairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/application~for-lifting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flat-belt-pulleys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562522%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulley-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K646&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K646%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-poles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-card-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K37&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K37%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6892 pages (at 48 pages/min), scraped 150 items (at 4 items/min)
2026-01-04 01:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/color~purple&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/belt-trade-size~5vx/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/application~for-lifting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/flat-belt-pulleys-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K646&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K646%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8470423702633&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8470423702633%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002012536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/flat-belt-pulleys-6/
2026-01-04 01:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/fitting-connection~slip-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/flexibility~extra-flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/belt-type~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-socket-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/for-belt-trade-size~5vx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/v-belt-type~banded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8470423702633&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8470423702633%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002012536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/application~for-lifting&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/for-belt-trade-size~5vx/
2026-01-04 01:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K646&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K646%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/connection-style~slip-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/flexibility~very-flexible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/for-belt-type~round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nasm15795/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~23-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/for-v-belt-type~banded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/pulleys-for-wire-rope-for-lifting-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plugs/connection-style~slip-on/
2026-01-04 01:27:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/insulation/flexibility~very-flexible/
2026-01-04 01:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:27:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/for-belt-type~round/
2026-01-04 01:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005187910%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/for-v-belt-type~banded/
2026-01-04 01:28:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/pulleys-for-wire-rope-for-lifting-6/
2026-01-04 01:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498422%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6940 pages (at 48 pages/min), scraped 151 items (at 1 items/min)
2026-01-04 01:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nasm-15795-819-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69115K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269115K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tack-cloth/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~28-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~28-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/air-hose/id~2mm/
2026-01-04 01:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~4-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9176T19&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229176T19%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562456%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power~1-18-hp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-evident-bottles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500925%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tack-cloth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6720T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226720T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3890N24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223890N24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50415K64&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250415K64%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-evident-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/power~1-18-hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-evident-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500925%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000006137274%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-evident-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-use-with~nitric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-use-with~salt-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/length~100-yd/length~300-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:10 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000006137274%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/power~1-18-hp&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 6989 pages (at 49 pages/min), scraped 156 items (at 5 items/min)
2026-01-04 01:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-rivet-installation-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500925%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001631801%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tank-rulers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plugs/for-use-with~water/
2026-01-04 01:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/material~bronze-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5306N38&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225306N38%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4373N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224373N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/material~ceramic-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500925%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collet-pullers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-rulers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000160620%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=interference-suppressing-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/number-of-wires~8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~11-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~12-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tap-and-drill-rulers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~18-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516753%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum/material~aluminum-2/material~7075-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~21-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collet-pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K39&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K39%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~11-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~12-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-and-drill-rulers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~18-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7036 pages (at 47 pages/min), scraped 158 items (at 2 items/min)
2026-01-04 01:30:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~11-32/
2026-01-04 01:30:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~12-5mm/
2026-01-04 01:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/material~aluminum/material~7075-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~22-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~21-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~18-6mm/
2026-01-04 01:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~47-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5069306377488&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5069306377488%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~20mm/
2026-01-04 01:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/collets/size~21-mm/
2026-01-04 01:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tapered-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/material~aluminum-2/material~6020-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=io-link-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-connection-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~22-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5069306377488&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5069306377488%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510688%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~47-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plumbers-lard-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plumb-bobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~22-5mm/
2026-01-04 01:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tapered-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-angle-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~63-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/collets/size~47-64/
2026-01-04 01:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tapping-screw-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/component~collet-nut/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/nema-type~l19-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/color-coded-feeler-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/column-protectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plumbers%27-lard-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tear-away-cable-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7080 pages (at 44 pages/min), scraped 159 items (at 1 items/min)
2026-01-04 01:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~63-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tapping-screw-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/component~collet-nut&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plumbing-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l19-30-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/collets/size~63-64/
2026-01-04 01:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=color-coded-feeler-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=column-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002232670%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tear-away-cable-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/purge-compound-pellets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-06b-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2532A57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222532A57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plunge-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/nema-type~l7-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-46-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~2-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=purge-compound-pellets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-guide-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push%252fpull-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l7-15-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cord-reels/ul-file-number~e38671&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-hex-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/american-wire-gauge-awg~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/telephone-wire-crimpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7130 pages (at 50 pages/min), scraped 160 items (at 1 items/min)
2026-01-04 01:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9834004401048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cord%20reels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9834004401048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005206378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~2-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4804K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224804K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-alarms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/cable-awg~16-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/cable-awg~10-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telephone-wire-crimpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/combination-wrenches/size~2-3-4/
2026-01-04 01:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561130%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=j-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561360%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nema-straight-blade-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~no-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7248K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227248K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K701&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K701%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/combination-wrenches/size~no-20/
2026-01-04 01:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=j-hook-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/push-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-straight-blade-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/comfort-grip-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/ul-file-number~e115330&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7248K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227248K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/cable-designation~stw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/push-lock-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005167358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7179 pages (at 49 pages/min), scraped 162 items (at 2 items/min)
2026-01-04 01:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/color~black-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temporary-glue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=comfort-grip-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K701&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K701%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7248K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227248K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K701&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K701%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-lock-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compound-pressure-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temporary-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stickers/message~push/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/electrical-connection~pin-and-sleeve&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7248K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227248K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-lead-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/material~aluminum-2/material~2024-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compound-pressure-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulating-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003069963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jacobs-j440-tap-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-hacksaw-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5481N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225481N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-breaker-poles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-lead-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7226 pages (at 47 pages/min), scraped 164 items (at 2 items/min)
2026-01-04 01:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/material~aluminum/material~2024-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tote-boxes/space-saving-features~nestable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compression-force-gauge-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510120%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nestable-trays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-outlets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nestable-tote-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-force-gauge-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-palm-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compression-spring-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/neutralizers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~1-1-8-7-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nestable-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermal-interface-materials/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:34:56 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/computer-glasses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-spring-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=neutralizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-quick-disconnects&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-094&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-1-8-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermal-interface-materials&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7272 pages (at 46 pages/min), scraped 165 items (at 1 items/min)
2026-01-04 01:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-glasses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/jam-nuts/thread-size~1-1-8-7/
2026-01-04 01:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-safety&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nickel-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nickel-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concrete-leveling-compounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pocket-alignment-lasers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squares/material-grade~fiberglass/material-grade~gpo3-fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/condiments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conductive-cable-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concrete-leveling-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-grade-fiberglass-(gpo3)-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=condiments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conductive-cable-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipper-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m52&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-trim&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7318 pages (at 46 pages/min), scraped 165 items (at 0 items/min)
2026-01-04 01:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/fitting-connection~butt-weld/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-clevises/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454977%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/fitting-connection~quick-disconnect/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-coated-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipper-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454977%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m52&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulating-pry-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/connection-style~butt-weld&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/for-use-with~boric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-clevises&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/connection-style~quick-disconnect&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=poles/material~garolite-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-coated-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nipples/connection-style~butt-weld/
2026-01-04 01:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nipples/connection-style~quick-disconnect/
2026-01-04 01:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conflat-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conflat-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992979646156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=poles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992979646156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003432806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-extrusions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~boric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ticket-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-pipe-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jars/capacity~270-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964962%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conflat-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conflat-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=62075583092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jars&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B62075583092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002149731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7361 pages (at 43 pages/min), scraped 165 items (at 0 items/min)
2026-01-04 01:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-extrusions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53505K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253505K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ticket-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-pipe-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3999T4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223999T4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/contact-cement/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-brackets/material~plastic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jars/capacity~175-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-pipe-reducers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/contour-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jars/capacity~2-3-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1848355731235&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=angle%20brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1848355731235%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/for-use-with~sodium-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contact-cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jars/capacity-weight-~175-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=enclosures/environment~corrosive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-plug-lockouts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-pipe-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contour-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jars/capacity-weight-~2-3-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/jars/capacity-weight-~175-ml/
2026-01-04 01:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4443870537041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=enclosures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4443870537041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~sodium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/jars/capacity-weight-~2-3-ml/
2026-01-04 01:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tinners-hammers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7407 pages (at 46 pages/min), scraped 167 items (at 2 items/min)
2026-01-04 01:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-plungers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-test-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tip-drive-shoulder-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8798T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228798T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tinners%27-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aramid-fabric-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-test-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/copper-hammers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aramid-gasket-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tip-drive-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jib-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/thread-size~m6-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/thread-type~bspp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arm-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-sockets/signal-type~video/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cordura-reinforced-slings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=asme-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/thread-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-sockets/connector-shell-size~24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-assembly-compression-tube-fitting-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/thread-type~bspp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nipples/thread-size~m6/
2026-01-04 01:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7455 pages (at 48 pages/min), scraped 168 items (at 1 items/min)
2026-01-04 01:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nitrile-vibration-damping-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-sockets/application~video&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8358313672822&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8358313672822%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001567231%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cordura-reinforced-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000037076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tool-counterbalancing-arms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8358313672822&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8358313672822%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002344439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6168T116&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226168T116%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jt3-chuck-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-assembly-compression-tube-fitting-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~1-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrile-vibration-damping-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tool-dip-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-counterbalancing-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=axles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536341%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corporation-cocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/alligator-belt-lacing/lacing-number~00/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrosion-inhibiting-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-tape/color~blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4138N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224138N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-angles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=704271490290&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B704271490290%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axles/diameter~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-dip-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corporation-cocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~30-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-00-alligator-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-inhibiting-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=704271490290&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B704271490290%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-tape/color~blue&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tooling-component-spring-stops/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7502 pages (at 47 pages/min), scraped 170 items (at 2 items/min)
2026-01-04 01:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=axles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000160942%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/alligator-belt-lacing/lacing-number~20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~4mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/top-notch-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-duct-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1482K49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221482K49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bags/capacity~15-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-dust-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/axles/diameter~4mm/
2026-01-04 01:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tooling-component-spring-stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wire/american-wire-gauge-awg~28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/counter-pens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-20-alligator-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=top-notch-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~15-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1482K49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221482K49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cove-router-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-fans/for-duct-diameter~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bags/capacity-weight-~15-gal-/
2026-01-04 01:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/material~rubber-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpc-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/no-parking-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counter-pens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9102215783954&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=exhaust%20fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9102215783954%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crack-chasers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3965717477234&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bags&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3965717477234%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7547 pages (at 45 pages/min), scraped 170 items (at 0 items/min)
2026-01-04 01:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1482K49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221482K49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:13 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9102215783954&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=exhaust%20fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9102215783954%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-fans/for-duct-diameter~8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-disconnect-tube-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kevlar-nylon-round-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cove-router-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpc-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-parking-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-protector-plugs/material~polyethylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crack-chasers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1482K49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221482K49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-disconnect-tube-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-exhaust-relief-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-release-pin-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-thread-protector-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/touch-free-door-pulls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expansion-joints/food-industry-standard~nsf-ansi-61&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-exhaust-relief-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7692142082491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=expansion%20joints&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7692142082491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002097343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wire/ul-file-number~e30117&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-release-pin-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000077724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=key-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=touch-free-door-pulls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005167782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crimpers/for-wire-cable-type~power/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=key-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7692142082491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=expansion%20joints&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7692142082491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002097343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7595 pages (at 48 pages/min), scraped 170 items (at 0 items/min)
2026-01-04 01:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005167782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonmagnetic-hex-keys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=key-ring-retractors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cord-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimpers/for-wire-cable-type~power&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=key-stock-assortments/tolerance-rating~oversized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-turn-polypropylene-tube-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7692142082491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=expansion%20joints&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7692142082491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002097343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969396%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9990284831616&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=key%20stock%20assortments&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9990284831616%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065716%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005167782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonmagnetic-packing-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmagnetic-hex-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7692142082491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=expansion%20joints&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7692142082491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002097343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonmagnetic-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/electrical-connection~straight-blade/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flashlights/flashlight-type~keychain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/traffic-directing-flashlights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005167782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hasps/hasp-type~keyed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonmagnetic-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmagnetic-packing-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmagnetic-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/connection-type~straight-blade&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyed-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barbed-tube-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keychain-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=traffic-directing-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/connection-type~straight-blade/
2026-01-04 01:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7644 pages (at 49 pages/min), scraped 170 items (at 0 items/min)
2026-01-04 01:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyed-hasps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barriers/material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmagnetic-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barriers/material~glass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonmetallic-conduit-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rabbet-router-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/transfer-needles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-bag-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/racks/component~frame-hanger/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/material~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/material~glass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamps/performance~nonsparking-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmetallic-conduit-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rabbet-router-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/barriers/material~copper/
2026-01-04 01:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/barriers/material~glass/
2026-01-04 01:43:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/crowfeet/size~2-1-8/
2026-01-04 01:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-bag-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=transfer-needles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=racks/component~frame-hanger&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-size~31&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/racks/storage-furniture-component~upright/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonsparking-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=684483403398&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B684483403398%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002243426%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030357%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-pipe-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extruded-acrylic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7688 pages (at 44 pages/min), scraped 170 items (at 0 items/min)
2026-01-04 01:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:14 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=684483403398&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B684483403398%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002243426%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=racks/component~frame-hanger&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=racks/component~upright&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eye-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eye-lag-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/current-transformers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bins/material~polystyrene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/racks/component~upright/
2026-01-04 01:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cut-resistant-footwear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-tote-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/truck-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-tube-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/noryl-round-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=current-transformers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polystyrene-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cut-resistant-footwear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nosepieces/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polystyrene-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=truck-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fan-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/railroad-jacks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=noryl-round-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/railroad-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~o1122/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nosepieces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7736 pages (at 48 pages/min), scraped 170 items (at 0 items/min)
2026-01-04 01:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electronics-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=railroad-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fan-shrouds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3002&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyurethane-elastomers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=railroad-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~o1122&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinder-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/blade-diameter~40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~o1122/
2026-01-04 01:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-dispensing-squeezers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~sar26r/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~sc4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005011972%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~y101/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/ul-file-number~e137077&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyurethane-rolls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-dispensing-squeezers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~sar26r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyurethane-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001577804%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~sc4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~sar26r/
2026-01-04 01:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~y101&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001577804%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/ul-file-number~e137077&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~sc4/
2026-01-04 01:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elmers-glue-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7785 pages (at 49 pages/min), scraped 170 items (at 0 items/min)
2026-01-04 01:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~y101/
2026-01-04 01:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dc-voltage-turn-lock-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/deck-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tungsten-electrode-sharpeners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyurethane-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6307&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pooper-scoopers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~0-586-32-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dc-voltage-turn-lock-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=deck-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten-electrode-sharpeners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=emi-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nozzles/spray-pattern~multiple-stream/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449209%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/deodorizers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0774&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/desiccant-packs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tweezer-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-industry-number~13n10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=emi-rfi-shielding-electrical-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/spray-pattern~multiple-stream&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=porous-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=deodorizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/twine/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9830859981210&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9830859981210%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052108%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=desiccant-packs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7834 pages (at 49 pages/min), scraped 170 items (at 0 items/min)
2026-01-04 01:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezer-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/tig-torch-nozzles/industry-number~13n10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10095K84&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210095K84%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ratchets/power-source~battery/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torches/cooling-method~water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nozzles/tig-torch-nozzles/industry-number~13n10/
2026-01-04 01:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twine&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/board-holders/compartment-type~development-board/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r133&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchets/power-source~battery&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/water-cooled-tig-torches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115613%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=female-threaded-standoffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=portable-stairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=enclosure-humidistats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-board-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988466368360&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988466368360%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076444%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nozzles/water-cooled-tig-torches/
2026-01-04 01:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=portable-wheel-risers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=type-thhn%252fthwn-building-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nut-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fh-032-6-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ultra-fine-filtering-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7883 pages (at 49 pages/min), scraped 171 items (at 1 items/min)
2026-01-04 01:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=position-indicators/environment~submersible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~19-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-0180/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/finish~chrome-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nut-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~210-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fh032-6-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975824483629&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=position%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975824483629%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000051516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultra-fine-filtering-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147735%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0180&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/finish~chrome-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/finish~neoprene-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000160606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/nut-type~locknut/fastener-strength-grade-class~iso-class-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~32-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=positive-displacement-drum-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=post-label-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000160606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0180&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/finish~neoprene-rubber-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000081559%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/din-panel-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/fastener-strength-grade-class~class-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nuts/finish~neoprene-rubber-coated/
2026-01-04 01:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7930 pages (at 47 pages/min), scraped 171 items (at 0 items/min)
2026-01-04 01:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=post-pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000141370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~2956&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=file-jackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-panel-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/posts/mounting-location~through-panel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~5-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3230&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400283%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/files/for-use-on~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000061473%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000141370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/nut-type~locknut/thread-size~1-312-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=posts/mount-type~panel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3408&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/urethane-casting-compounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A807&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A807%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=files/for-use-on~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9967987003482&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=posts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9967987003482%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401100%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=files/for-use-on~copper-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~1-312-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000141370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/files/for-use-on~aluminum/
2026-01-04 01:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3769&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=urethane-casting-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7794418569789&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=files&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7794418569789%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 7981 pages (at 51 pages/min), scraped 172 items (at 1 items/min)
2026-01-04 01:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3976&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/nut-type~locknut/thread-size~2-360-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400599%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-0835/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401549%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=potting-compounds/for-use-on~bronze-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000141370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/usb-expansion-hubs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A807&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A807%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~1-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8322972566281&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=potting%20compounds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8322972566281%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929664%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~2-360-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~428m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0835&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pouch-laminators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=usb-expansion-hubs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A807&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A807%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disposable-funnels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~13-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=poulan-compatible-chain-saw-chains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-shaft-diameter~1-3-4/
2026-01-04 01:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:02 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0835&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~a1011-l4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~16-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A807&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A807%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8026 pages (at 45 pages/min), scraped 173 items (at 1 items/min)
2026-01-04 01:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disposable-funnels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-groove-milling-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-shaft-diameter~13-16/
2026-01-04 01:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a1011-l4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~16mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-005&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A807&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A807%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1025&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-groove-milling-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~a1011-l4/
2026-01-04 01:51:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-shaft-diameter~16mm/
2026-01-04 01:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161092%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001726682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-021&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/construction~fibrous&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161092%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1025&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-evaporation-boats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-05&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001701921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002428523%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cord-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001729620%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8832A37&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228832A37%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001726682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001742673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-cords/iec-connector-type~c5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-evaporation-boats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-cords/international-power-connector-standard~si-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8832A53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228832A53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8075 pages (at 49 pages/min), scraped 174 items (at 1 items/min)
2026-01-04 01:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~0-497/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cords/iec-style~c5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-cords/manufacturer~milwaukee-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001726682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cords/international-end-style~si-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~by11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/power-cords/iec-style~c5/
2026-01-04 01:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-497&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/power-cords/international-end-style~si-32/
2026-01-04 01:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~by14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-sealers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-resistant-welding-clothing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1400/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cords/manufacturer~milwaukee&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001743009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001726682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~10-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400986%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/power-cords/manufacturer~milwaukee/
2026-01-04 01:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1405/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3940N22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223940N22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001740504%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-sealers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1400&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8853A772&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228853A772%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-drip-edges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8124 pages (at 49 pages/min), scraped 177 items (at 3 items/min)
2026-01-04 01:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~cat65&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~12-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1405&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1545/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399081%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001730953%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fixed-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-drip-edges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=30245A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2230245A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1405&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:53:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/material~ptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1545&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1585/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-reinforcers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031264%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-stop-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~m2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-disconnect-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031264%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1545&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~1mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1585&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-reinforcers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vbmt-carbide-insert-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1750/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-stop-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8170 pages (at 46 pages/min), scraped 179 items (at 2 items/min)
2026-01-04 01:54:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/end-mills/mill-diameter~1mm/
2026-01-04 01:54:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022011%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~m2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-clevis-links/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vehicle-reflectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~m2/
2026-01-04 01:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vbmt-carbide-insert-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1750&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanged-iron-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071487%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-clevis-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vehicle-reflectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~1-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399097%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/fitting-connection~slip-on-weld/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dovetail-blanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071487%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1750&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002263047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002269609%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~8-36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399097%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/connection-style~slip-on-weld&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dovetail-blanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~5-33-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2100/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-995-adhesives%252fsealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8218 pages (at 48 pages/min), scraped 179 items (at 0 items/min)
2026-01-04 01:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flanges/connection-style~slip-on-weld/
2026-01-04 01:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147572%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~8-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001710334%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=endless-ratchet-straps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-2510/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399097%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~m165/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8207A473&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228207A473%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/specifications-met~semi-f47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-2510&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399097%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002241598%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m165&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:50 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2100&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2205/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~m26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553761%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~sh6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449008%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/video-surveillance/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/specifications-met~semi-f47-compliant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553761%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-2510&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2455/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2205&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8263 pages (at 45 pages/min), scraped 180 items (at 1 items/min)
2026-01-04 01:56:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/power-supplies/specifications-met~semi-f47-compliant/
2026-01-04 01:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vise-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sh6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~pg-48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=video-surveillance&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000016358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2455&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~sh6/
2026-01-04 01:56:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/manufacturer~abloy-security&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:33 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000016358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2205&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vise-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2570/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039936%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2660/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~pg-48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vix-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002233380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drift-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454841%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-brush-weatherstripping/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vulcanized-fiber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2570&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2735/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2660&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3185K133&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223185K133%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vix-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drift-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000154183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-bushing-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vulcanized-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8308 pages (at 45 pages/min), scraped 181 items (at 1 items/min)
2026-01-04 01:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-brush-weatherstripping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2735&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:14 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2570&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:57:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000154183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2660&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2805/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/walkie-talkie-protective-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~12-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/color~light-gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:33 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2735&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wall-mount-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~1-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002200122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wall-pass-throughs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-metal-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2805&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=walkie-talkie-protective-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000094110%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~12mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126785%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-mount-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~1-5-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:57:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/width~12mm/
2026-01-04 01:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-insert-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-pass-throughs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:57:59 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126785%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2805&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 01:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wardrobes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-orifice-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-mesh-abrasive-flap-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8357 pages (at 49 pages/min), scraped 181 items (at 0 items/min)
2026-01-04 01:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keystone-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyway-nibblers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-insert-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wardrobes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~10-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers-for-low-strength-anchor-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-mesh-abrasive-flap-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448476%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-mesh-wool/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98935A748&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298935A748%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-pipe-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-test-weights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers-for-low-strength-anchor-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kitchen-sinks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-mesh-wool&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~0151&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98935A748&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298935A748%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-pipe-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~1-7-mm/
2026-01-04 01:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~5-16-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8405 pages (at 48 pages/min), scraped 181 items (at 0 items/min)
2026-01-04 01:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334815%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1813A253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221813A253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~10760&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98935A748&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298935A748%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~11-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~13-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-control-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-brooms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-framing-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98935A748&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298935A748%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 01:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-standoffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3505/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~305-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~13-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-rotary-vane-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~11-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-brooms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~62345&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~13-5-mm/
2026-01-04 01:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~2-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 01:59:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~11-64/
2026-01-04 01:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-twine/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3505&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=66195A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2266195A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/epoxies/manufacturer-model-number~62345/
2026-01-04 02:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-standoffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-rotary-vane-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~2-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8453 pages (at 48 pages/min), scraped 182 items (at 1 items/min)
2026-01-04 02:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~2-85-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~2-6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/manufacturer~stanley&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-twine&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3505&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=66195A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2266195A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~2-6-mm/
2026-01-04 02:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3645/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002256836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~2-85-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/grip-style~seven-arm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/screw-size~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-ring-installation-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7086A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227086A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~2-85-mm/
2026-01-04 02:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/handle-style~low-profile&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=66195A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2266195A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3645&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3870/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/mount-type~freestanding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/grip-style~seven-arm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/for-screw-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060803%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-ring-installation-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=66195A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2266195A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:01:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/brackets/for-screw-size~1-4/
2026-01-04 02:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:06 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060803%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3645&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3870&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/thread-size~8-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8501 pages (at 48 pages/min), scraped 183 items (at 1 items/min)
2026-01-04 02:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxy-adhesive-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3930/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/color~orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140264%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334402%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/for-use-with~propane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxy-coating-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:30 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140264%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3870&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=339191585183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B339191585183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~4-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3930&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/color~orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~002/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4010/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000169506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~041/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~4-8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000169506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3930&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~002&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=equipment-cooling-fan-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4010&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~4-8-mm/
2026-01-04 02:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~043/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~6-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000148157%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8548 pages (at 47 pages/min), scraped 183 items (at 0 items/min)
2026-01-04 02:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~041&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=equipment-tripods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4010&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-ansi-pipe-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~6-9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~043&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=er-20-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-barbed-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K129&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K129%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~6-9-mm/
2026-01-04 02:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-face-shields/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=label-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4440/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=er-70s-6-tig-welding-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fold-up-steps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K129&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K129%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=labels/message~handle-with-care&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=erasers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-hose-reels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-face-shields&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4440&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4515/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9970880776468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=labels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9970880776468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002253669%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~s/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8597 pages (at 49 pages/min), scraped 184 items (at 1 items/min)
2026-01-04 02:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K129&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K129%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000036028%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4595/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-hose-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4605/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=14385T33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2214385T33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000036028%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4440&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4515&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~s&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K129&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K129%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4595&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~s/
2026-01-04 02:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4645/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4605&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4515&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:03:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-wire-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000068885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-pipe-hex-socket-pipe-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lacquers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~253/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4645&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:56 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4595&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:03:58 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000068885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4605&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/splitters/signal-type~data/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-handrail-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-wire-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~264/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8645 pages (at 48 pages/min), scraped 185 items (at 1 items/min)
2026-01-04 02:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~253&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:16 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4645&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fractional-jobbers-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-levelers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/for-use-with~acetylene-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000094313%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4945/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nails/for-use-on~softwood/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ethernet-splitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~264&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968999%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K354&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K354%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=european-power-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~312/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/for-use-with~deionized-water-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4945&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/nails-for-soft-woods-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~332/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K203&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K203%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000010453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/framing/nails-for-soft-woods-6/
2026-01-04 02:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-5300/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~312&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/for-use-with~deionized-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-vent-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:01 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000010453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4945&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~345/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pressure-gauges/for-use-with~deionized-water/
2026-01-04 02:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~332&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-5580/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~58-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8690 pages (at 45 pages/min), scraped 187 items (at 2 items/min)
2026-01-04 02:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K385&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K385%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wind-driven-ventilators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000113955%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/exhaust-fan-guards/blade-diameter~42/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~2000-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~345&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092662%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5580&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~58-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000015203%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092662%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5300&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-to-scaffold-conversion-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K385&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K385%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wind-driven-ventilators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-fan-guards/for-blade-diameter~42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~58-mm/
2026-01-04 02:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~2000-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/exhaust-fan-guards/for-blade-diameter~42/
2026-01-04 02:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~388/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~389/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pressure-gauges/maximum-pressure-psi~2000-psi/
2026-01-04 02:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~360-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~406/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K385&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K385%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~t10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-7250/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~388&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~389&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~8-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fume-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8736 pages (at 46 pages/min), scraped 188 items (at 1 items/min)
2026-01-04 02:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~406&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K385&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K385%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144557%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035943%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~t10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-7250&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092471%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~360-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K524&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K524%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~t10/
2026-01-04 02:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~8-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acme-nuts/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000030981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K502&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K502%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001711337%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001703189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000030981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-7250&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~2-2000-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=landscaping-rakes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-precision-acme-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-benders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K502&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K502%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/measures~differential-vacuum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=furniture-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~2-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-thrust-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-benders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8788 pages (at 52 pages/min), scraped 189 items (at 1 items/min)
2026-01-04 02:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K502&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K502%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/diameter~2-2mm/
2026-01-04 02:07:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/measures~differential-vacuum&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-tooth-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/fuse-protection-type~fast-acting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-cloth-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-8850/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/measurement-unit~decanewtons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-decking/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002189435%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-compactors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K502&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K502%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~467/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~1-6500-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cloth-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-8850&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/scale~decanewtons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laptop-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-mesh-conduit-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-decking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002189435%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~467&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:07:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pressure-gauges/scale~decanewtons/
2026-01-04 02:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-compactors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~1-6500-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-8850&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~13-5000-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-ramps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022444%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-mesh-conduit-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8830 pages (at 42 pages/min), scraped 189 items (at 0 items/min)
2026-01-04 02:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002189435%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K461&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K461%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity~22-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~1-6500-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=garage-door-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-ramps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~13-5000-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laser-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=104738336527&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=buckets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B104738336527%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116161%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002189435%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expanded-polystyrene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-plug-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~2-7500/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laser-levels/environment~dusty&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-repair-patches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:48 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~13-5000-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-shelving-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-spouts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5032840065813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=laser%20levels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5032840065813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-plug-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-receivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity~40-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~2-7500&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-repair-patches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-tilters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=104738336527&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=buckets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B104738336527%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099022%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-shelving-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000012448%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8880 pages (at 50 pages/min), scraped 190 items (at 1 items/min)
2026-01-04 02:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-spouts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laser-safety-glasses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-tension-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/shank-type~round/reamer-type~for-hole-alignment/performance~depth-limiting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000012448%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~2-7500&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/length-class~short/shank-type~round/reamer-type~for-hole-alignment/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/latches/mount-type~unthreaded-plug/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wireless-borescopes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-tilters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wiremold-compatible-raceways/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wireless-transmitters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-tension-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/round-shank-reamers-for-hole-alignment-with-safety-collar&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/opens-with~hex-key&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reamers/round-shank-reamers-for-hole-alignment-with-safety-collar/
2026-01-04 02:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/short-length-round-shank-reamers-for-hole-alignment&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/mount-type~expanding-plug&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wireless-borescopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9731295768502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9731295768502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969221%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/system-of-measurement~wire-gauge/material~cobalt-steel/shank-type~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wireless-transmitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reamers/short-length-round-shank-reamers-for-hole-alignment/
2026-01-04 02:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wiremold-compatible-raceways&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:09:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/latches/mount-type~expanding-plug/
2026-01-04 02:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/opens-with~square-key&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-switches/hazardous-location-protection-type~explosion-proof-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=budgit-hoists&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9731295768502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9731295768502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/wire-gauge-cobalt-steel-round-shank-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8926 pages (at 46 pages/min), scraped 190 items (at 0 items/min)
2026-01-04 02:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/received-stamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=built-in-locker-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expansion-joints/pipe-size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gas-spring-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reamers/wire-gauge-cobalt-steel-round-shank-reamers/
2026-01-04 02:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-washer-couplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-vent-proof-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7692142082491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=expansion%20joints&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7692142082491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074440%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=received-stamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/recessed-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5303N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225303N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/color~black-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gasket-material/for-use-with~beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressurized-water-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathe-tool-insert-holder-shims&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992574902667&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gasket%20material&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992574902667%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=recessed-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct-cleanout-doors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extendable-ratchets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/mount-type~bolt-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/for-use-with~acetic-acid-white-vinegar/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/for-use-on~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bungs/pipe-material~steel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-cleanout-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 8974 pages (at 48 pages/min), scraped 191 items (at 1 items/min)
2026-01-04 02:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:13 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/mount-type~bolt-on&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buna-n-rubber-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~cpvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~acetic-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bungs/for-pipe-material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7559498251638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7559498251638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gaskets/for-use-with~acetic-acid/
2026-01-04 02:11:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/primers/for-use-on~brass/
2026-01-04 02:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7559498251638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7559498251638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929750%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/offices/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~009754-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bungs/for-pipe-material~steel/
2026-01-04 02:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~012442-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/for-use-on~plastic-1/for-use-on~nylon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/offset-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104428%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/for-use-with~r-12-refrigerant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138656%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=offices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:50 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138656%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~012442-40&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~113-124a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~plastic-1/for-use-on~polycarbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~nylon-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=offset-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104428%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-control-air-barriers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~refrigerant-r-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128609%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7559498251638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7559498251638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/primers/for-use-on~nylon-plastic/
2026-01-04 02:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-mop-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-washer-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gaskets/for-use-with~refrigerant-r-12/
2026-01-04 02:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9023 pages (at 49 pages/min), scraped 191 items (at 0 items/min)
2026-01-04 02:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dustless-chalk/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104428%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-control-air-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/for-use-on~chutes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dwb-couplers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-mop-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~129-009&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gate-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/current~12-0-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dustless-chalk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104428%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~41-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-use-on~chutes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dwb-couplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/electrical-connection~straight-blade/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~50-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/for-use-on~threaded-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/current~12a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/for-use-on~turbines/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~41millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/for-use-with~argon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/connection-type~straight-blade&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/current~12a/
2026-01-04 02:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~41millimeters/
2026-01-04 02:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/for-use-with~breathable-air/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~50millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-use-on~threaded-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reducers/connection-type~straight-blade/
2026-01-04 02:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9068 pages (at 45 pages/min), scraped 191 items (at 0 items/min)
2026-01-04 02:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-use-on~turbines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edge-finders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~50millimeters/
2026-01-04 02:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~argon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~breathable-air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/ed23-1%2f2-light-bulbs already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~6045051-002&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edge-finders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964983%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=printer-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edm-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eductors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7897A57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227897A57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~6045051-002&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/sae-viscosity-grade~0w-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edm-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=printers/manufacturer~sato&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eductors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~8111&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-048&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=privacy-locksets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/sae-viscosity-grade~15w-50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992728463794&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=printers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992728463794%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002278025%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/sae-viscosity-grade~0w-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002152046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9118 pages (at 50 pages/min), scraped 193 items (at 2 items/min)
2026-01-04 02:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~srdt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003415246%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/cable-designation~stow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/sae-viscosity-grade~20w-50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/sae-viscosity-grade~15w-50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/for-shaft-diameter~7-8/
2026-01-04 02:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2276K68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222276K68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbow-toggle-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-1006&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/industry-designation~srdt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003415245%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electric-actuator-controls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=probe-styli&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000081381%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/industry-designation~srdt/
2026-01-04 02:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/industry-designation~stow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/sae-viscosity-grade~20w-50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8990N101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228990N101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-type~square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbow-toggle-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/industry-designation~stow/
2026-01-04 02:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003415233%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-actuator-controls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~b-2489-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=process-controllers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2276K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222276K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knives/knife-type~produce/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-type~square&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9162 pages (at 44 pages/min), scraped 195 items (at 2 items/min)
2026-01-04 02:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~t100/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~t1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=profile-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/for-shaft-type~square/
2026-01-04 02:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~b-2489&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/shape~90-elbow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=produce-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~b-2489/
2026-01-04 02:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/shaft-diameter~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~200-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/shape~cross/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~t100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~t1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electric-shear-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000118760%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/length~200-ft-/
2026-01-04 02:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~t100/
2026-01-04 02:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/shape~90-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~t1/
2026-01-04 02:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-box-extensions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~g-458-kl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/trade-name~lb-8801-silicone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/shape~cross&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-shear-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094089%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=projection-weld-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-box-extensions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:09 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094089%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~g-458-kl&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~lb-8801-silicone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9212 pages (at 50 pages/min), scraped 196 items (at 1 items/min)
2026-01-04 02:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-connector-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4880K061&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224880K061%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-dies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001598606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/shaft-diameter~28-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095545%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/thread-size~3-56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/thread-size~3-8-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000068465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10255K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210255K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-dies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-connector-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~3-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-ws1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~3-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/shaft-diameter~36-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/thread-size~7-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333442%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138830%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-insulating-spray/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002262360%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=91732A001&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2291732A001%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:03 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138830%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-ws1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/shaft-diameter~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~7-16-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=propane-tank-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9261 pages (at 49 pages/min), scraped 200 items (at 4 items/min)
2026-01-04 02:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/z-sections/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulating-spray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zero-throw-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333517%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/thread-size~m3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=propeller-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-gun-chisels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=z-sections&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zero-throw-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~m3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/for-use-with~pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/shaft-diameter~65-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=protective-bellows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butt-splices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~s45-197&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002236359%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-gun-chisels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/trade-name~molykote-m-77-paste/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducing-pipe-nipples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reflective-gloves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9310 pages (at 49 pages/min), scraped 200 items (at 0 items/min)
2026-01-04 02:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electronics-shelves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~molykote-m-77-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/emergency-push-buttons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gear-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=prototyping-machine-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=layout-blues&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128567%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducing-pipe-nipples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reflective-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electronics-shelves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/refrigerant-recovery-cylinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=emergency-push-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-breakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=external-tooth-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=external-torx-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=layout-compasses/manufacturer-model-number~c251c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extra-wide-thin-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=layout-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=refrigerant-recovery-cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/regulators/for-use-with~carbon-monoxide-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~2000v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7443438757064&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=layout%20compasses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7443438757064%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104741%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9362 pages (at 52 pages/min), scraped 200 items (at 0 items/min)
2026-01-04 02:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mill-arbors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~60v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~carbon-monoxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~garolite-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ptfe-grease-sprays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screw-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/regulators/for-use-with~carbon-monoxide/
2026-01-04 02:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003432021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/regulators/for-use-with~hydraulic-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mill-arbors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ptfe-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-piston-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~hydraulic-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-sights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=california-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~02azd730g-a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-piston-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~02azd730g-b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964432%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eye-wash-concentrates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxy-coating-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-sights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6871K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226871K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9411 pages (at 49 pages/min), scraped 200 items (at 0 items/min)
2026-01-04 02:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxy-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oilers/for-use-with~acetone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oilers/for-use-with~antiseize-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=graphite-and-carbon-fiber-bars-and-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/regulators/for-use-with~xenon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6871K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226871K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxy-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oilers/for-use-with~acetone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oilers/for-use-with~antiseize-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=puerto-rico-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gravity-roller-conveyors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~xenon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4227901971716&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4227901971716%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6871K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226871K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4227901971716&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4227901971716%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964927%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-chain-switch-light-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965347%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~1-1-2-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oilers/for-use-with~oil/for-use-with~solvents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:21:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6871K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226871K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9461 pages (at 50 pages/min), scraped 200 items (at 0 items/min)
2026-01-04 02:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/finish~cadmium-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/etching-stencils/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reinforcing-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ethernet-strain-relief/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~1-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539197%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oilers/for-use-with~oils-and-solvents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~1-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454010%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-handles/mount-type~adhesive-back&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2998K131&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222998K131%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=etching-stencils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/oilers/for-use-with~oils-and-solvents/
2026-01-04 02:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A031&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A031%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reinforcing-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ethernet-strain-relief&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K701&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K701%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-gun-extensions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1393964000724&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pull%20handles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1393964000724%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010855%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2434N2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222434N2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/evaporative-coolers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/relays/input-voltage~120v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/evaporator-fin-combs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=canvas-cloth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~m3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~7-8-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9510 pages (at 49 pages/min), scraped 204 items (at 4 items/min)
2026-01-04 02:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=evaporative-coolers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relays/input-voltage~120v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=evaporator-fin-combs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/open-assist-gas-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leaf-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7088615684115&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7088615684115%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001603602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/expanded-polystyrene-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/relays/switching-current~45-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/open-top-tanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=open-assist-gas-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/grit~120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expanded-polystyrene-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/plug-connection-method~locking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003150673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leather-gasket-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relays/switching-current~45a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=open-top-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/relief-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/orifice-valve-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/relays/switching-current~45a/
2026-01-04 02:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9559 pages (at 49 pages/min), scraped 204 items (at 0 items/min)
2026-01-04 02:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/removable-bolt-anchors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oscillating-multi-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003150673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulley-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relief-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=orifice-valve-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=removable-bolt-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/removable-paint-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oscillating-multi-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003150673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eyeglass-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/replaceable-core-cam-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leds/mounting-location~stake/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fabric-cutting-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=removable-paint-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:23:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003150673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:23:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyeglass-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=replaceable-core-cam-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-deburring-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reservoir-bottles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/facial-tissue-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=LEDs/mount-type~stake&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9605 pages (at 46 pages/min), scraped 204 items (at 0 items/min)
2026-01-04 02:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fall-arrest-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grippers/grip-style~plain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/LEDs/mount-type~stake/
2026-01-04 02:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/material~rubber-1/material~sbr/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/ethernet-cable-category~5e/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reservoir-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=608445669459&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grippers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B608445669459%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=facial-tissue-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/outlets/current~8-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fall-arrest-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leggings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=category-6-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/material~rubber/material~sbr-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=category-5e-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/faucet-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/current~8a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grommets/material~rubber/material~sbr-rubber/
2026-01-04 02:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirators/compatible-with~3m-6500-series/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/pulley-type~fixed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:24:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/outlets/current~8a/
2026-01-04 02:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/shaft-type~round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucet-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8470423702633&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pulleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8470423702633%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001973744%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/compatible-with~3m-6500-series&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-lathe-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9651 pages (at 46 pages/min), scraped 204 items (at 0 items/min)
2026-01-04 02:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8470423702633&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pulleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8470423702633%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/outlets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pulleys/material~brass/
2026-01-04 02:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rail-carriages/rail-width~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/shape~tapered-round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084555%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirators/for-use-with~odors-from-acid-gases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5834T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225834T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fan-blades/shaft-diameter~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=certified-tape-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=levels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9728K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229728K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/outlets already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pump-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8197494541975&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fan%20blades&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8197494541975%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164864%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/for-use-with~odor-from-acid-gases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/outlets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferraz-shawmut-type-a15qs-fuses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guided-actuators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:25:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/respirators/for-use-with~odor-from-acid-gases/
2026-01-04 02:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-glasses/lens-style~eyeglass-fit-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrites/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~081/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-4-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9698 pages (at 47 pages/min), scraped 206 items (at 2 items/min)
2026-01-04 02:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=levels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferraz-shawmut-type-a15qs-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/sash-chain-trade-size~25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=over-the-glasses-safety-glasses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fanny-packs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~081&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=levels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power~1-15-hp-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/roller-chain-trade-size~081/
2026-01-04 02:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power~1-20-hp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/trade-size~25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-bonding-epoxies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fibrous-rope-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/trade-size~25/
2026-01-04 02:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/niosh-approval~tc-84a-7234&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/horsepower~1-15-hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/horsepower~14-hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-protection&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifting-plate-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/respirators/niosh-approval~tc-84a-7234/
2026-01-04 02:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-bonding-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002995051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fibrous-rope-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002995132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power~1-64-hp-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pa-speakers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9743 pages (at 45 pages/min), scraped 206 items (at 0 items/min)
2026-01-04 02:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/package-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/power~1-64-hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemistry-meters/for-testing~temperature&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemours-krytox-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-winches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pa-speakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=package-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifts/power-source~battery&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pumps/power~1-64-hp/
2026-01-04 02:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3617097439066&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chemistry%20meters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3617097439066%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9983427256512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lifts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9983427256512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076444%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/packing/material~eptfe-fiber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/packing/material~paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/horsepower~1-20-hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3617097439066&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chemistry%20meters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3617097439066%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/retractable-extension-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~12-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing/material~eptfe-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002995037%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing/material~paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000135666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000112046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-blocking-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998639042139&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998639042139%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3617097439066&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chemistry%20meters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3617097439066%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9793 pages (at 50 pages/min), scraped 206 items (at 0 items/min)
2026-01-04 02:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998639042139&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998639042139%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractable-extension-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:16 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000135666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~10&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:28:18 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000112046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~12-1-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:28:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998639042139&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998639042139%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing/material~eptfe-fiber&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-keys/chuck-key-number~tkg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/finger-safe-terminal-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/retracting-extension-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/finish-head-wood-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3617097439066&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chemistry%20meters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3617097439066%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punch-down-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9311230464378&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chuck%20keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9311230464378%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002052884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chuck-keys/chuck-key-number~t1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3169A26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223169A26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finger-safe-terminal-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retracting-extension-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~16-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finish-head-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~bay15d/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~17-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083540%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-keys/key-number~t1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151071%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reverse-acting-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chuck-keys/key-number~t1/
2026-01-04 02:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fire-extinguisher-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~ex39/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-number~bay15d&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:08 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151071%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~17-3-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/padlock-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9840 pages (at 47 pages/min), scraped 207 items (at 1 items/min)
2026-01-04 02:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circular-gasket-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/base-number~bay15d/
2026-01-04 02:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~13-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reverse-acting-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hanging-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-extinguisher-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-number~ex39&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=padlock-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/base-number~ex39/
2026-01-04 02:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamp-on-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~13mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~gy6-35/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rexolite-polystyrene-sheet-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fire-resistant-foot-and-shin-guards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~24-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/punches/for-hole-diameter~13mm/
2026-01-04 02:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~3-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~31-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~4-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-number~gy6-35&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rexolite-polystyrene-sheet-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-resistant-foot-and-shin-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~plastic-1/for-use-on~polycarbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~3-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/base-number~gy6-35/
2026-01-04 02:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9887 pages (at 47 pages/min), scraped 207 items (at 0 items/min)
2026-01-04 02:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/punches/for-hole-diameter~3-7-8/
2026-01-04 02:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=headgear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~50-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clear-tarps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/punches/for-hole-diameter~4-1-2/
2026-01-04 02:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~5-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-base-number~gy9-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fixture-plate-chip-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clevis-pins/diameter~25-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~50mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000138365%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026667%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/hole-diameter~1-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1255618309250&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clevis%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1255618309250%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/punches/for-hole-diameter~50mm/
2026-01-04 02:30:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000138365%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~5-7-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K58&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K58%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-base-type~twist-and-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001675450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fixture-plate-chip-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1255618309250&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clevis%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1255618309250%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clevis-pins/diameter~25-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flagpole-halyard-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flag-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9936 pages (at 49 pages/min), scraped 208 items (at 1 items/min)
2026-01-04 02:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/color~dark-gray/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1732N127&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221732N127%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/color~fluorescent-orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rigging-swivels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flagpole-halyard-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flag-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/voltage~277v-ac-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/color~light-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cloth/material~plastic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~dark-gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1732N127&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221732N127%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~fluorescent-orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968537056579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cloth&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968537056579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539359%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/right-angle-screwdrivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigging-swivels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:45 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/voltage~277v-ac-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanged-shaft-collars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~light-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1732N127&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221732N127%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002202371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flared-power-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=right-angle-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanged-shaft-collars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coated-flat-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-treat-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 9983 pages (at 47 pages/min), scraped 208 items (at 0 items/min)
2026-01-04 02:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/drive-style~phillips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1732N127&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221732N127%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/color~white/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flared-power-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000077072%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rigid-insulation-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ring-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/hole-diameter~8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1133&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ring-shank-nails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1073&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigid-insulation-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001671157%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002327133%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326518%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-shank-nails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/finish~neoprene-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/for-use-on~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flexible-shaft-magnifiers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/paint/for-use-on~wood/
2026-01-04 02:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10031 pages (at 48 pages/min), scraped 209 items (at 1 items/min)
2026-01-04 02:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-brooms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002236603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-button-hole-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~neoprene-rubber-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A19&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A19%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-shaft-magnifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1495&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1460x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fasteners/finish~neoprene-rubber-coated/
2026-01-04 02:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-button-switch-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/fastener-head-type~bent/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321456%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flood-alarms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1591if&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drive-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T805&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T805%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K79&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K79%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326811%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1662&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flood-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/head-type~bent&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T669&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T669%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/driver-style~t-handle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint-pails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002319232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint-roller-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-in-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10082 pages (at 51 pages/min), scraped 214 items (at 5 items/min)
2026-01-04 02:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308620%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floor-outlining-shapes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T772&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T772%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1818&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-pails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326321%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1876&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint-sprayer-replacement-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-roller-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint-sticks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-outlining-shapes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002327103%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/diameter~0-188/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-sprayer-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T903&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T903%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1895g&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-shank-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/jis-specification~jis/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/diameter~0-188&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~194r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10129 pages (at 47 pages/min), scraped 217 items (at 3 items/min)
2026-01-04 02:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000118628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T045&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T045%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/specifications-met~jis&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-release-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/specifications-met~sae-ams5643&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98919A074&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298919A074%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/fastener-head-type~rounded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~265&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fasteners/specifications-met~jis/
2026-01-04 02:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-amp-electrical-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T501&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T501%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135260%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flush-mount-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325953%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foam-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/material~plastic-1/material~nylon/fitting-connection~threaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135260%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/specifications-met~sae-ams5643&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/head-type~rounded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T028&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T028%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rivets/head-type~rounded/
2026-01-04 02:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flush-mount-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-strength-white-nylon-threaded-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~316&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-connect-vacuum-tube-wyes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rivets/material~steel/
2026-01-04 02:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fog-generators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326744%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-reset-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10178 pages (at 49 pages/min), scraped 221 items (at 4 items/min)
2026-01-04 02:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivet-tools/rivet-type~locking-collar/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fasteners/thread-size~1-4-28/
2026-01-04 02:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fog-generators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-lacing/belt-width~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-temperature-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-lacing/belt-width~60&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~acrylic-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~12-28-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6363923171247&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6363923171247%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000061340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/tools-for-locking-collar-rivets-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6363923171247&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6363923171247%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117316%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hilti-compatible-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivnuts/thread-size~4-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=putty&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930055%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6016K251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226016K251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%227299391406196%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~2-1-2-12-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~12-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~4156ll&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96899A400&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296899A400%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-grade-absorbents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivnuts/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fasteners/thread-size~12-28/
2026-01-04 02:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6363923171247&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6363923171247%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117316%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6016K251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226016K251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323627%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~grout&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9987127587466&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9987127587466%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~2-3-4-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10231 pages (at 53 pages/min), scraped 222 items (at 1 items/min)
2026-01-04 02:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T449&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T449%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96899A400&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296899A400%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=putty&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-grade-absorbents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6363923171247&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6363923171247%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117316%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6016K251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226016K251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449109%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9987127587466&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9987127587466%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~4413&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449109%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~2-3-4-4-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-rollers/between-frame-width~38/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96899A400&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296899A400%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6363923171247&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6363923171247%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117316%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002327093%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6016K251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226016K251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-service-wrap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~4509&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/leaf-type~offset/hinge-type~piano&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/panels/material~drywall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9987127587466&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9987127587466%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foot-operated-door-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8351K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228351K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/between-frame-width~38-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96899A400&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296899A400%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001973201%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969305%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-service-wrap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8351K233&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228351K233%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/conveyor-rollers/between-frame-width~38-1/
2026-01-04 02:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/panels/material~fabric-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1567A41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221567A41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panels/material~drywall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9987127587466&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9987127587466%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foot-operated-door-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8351K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228351K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10281 pages (at 50 pages/min), scraped 224 items (at 2 items/min)
2026-01-04 02:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robot-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962166674953&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962166674953%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/panels/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panels/material~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~5-8-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8351K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228351K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/panels/material~fabric/
2026-01-04 02:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-loctite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~7506&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-enlarging-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panels/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321354%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/panels/material~steel/
2026-01-04 02:38:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8351K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228351K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paper/for-use-on~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m135&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paper/for-use-on~ceramic-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K238&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K238%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foxtail-brooms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~8918&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10330 pages (at 49 pages/min), scraped 226 items (at 2 items/min)
2026-01-04 02:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/for-use-on~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/for-use-on~ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foxtail-brooms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/paper/for-use-on~brass/
2026-01-04 02:39:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/paper/for-use-on~ceramic/
2026-01-04 02:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paper/for-use-on~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-float-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paper-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hollow-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/for-use-on~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~906r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers-for-cross-bracing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~912f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/paper/for-use-on~steel/
2026-01-04 02:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325468%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hood-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/freeze-resistant-shower-stations/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T936&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T936%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~workstation/manufacturer~universal-robots/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/washers-for-cross-bracing-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T922&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T922%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10381 pages (at 51 pages/min), scraped 227 items (at 1 items/min)
2026-01-04 02:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/framing/washers-for-cross-bracing-6/
2026-01-04 02:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=freeze-resistant-shower-stations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~922&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~94&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~workstation/manufacturer~universal-robots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~e211-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325133%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~e211-2p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116206%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324391%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuel-cylinders-for-propane-torches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/furnaces/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/color~copper-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T909&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T909%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321708%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5206N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225206N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T163&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T163%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~f14t5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fastening%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T167&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T167%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=furnaces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuel-cylinders-for-propane-torches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76555A721&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276555A721%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T909&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T909%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~coolant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10432 pages (at 51 pages/min), scraped 231 items (at 4 items/min)
2026-01-04 02:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/hose-oil-resistance-class~a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T167&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T167%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/width~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rod-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76555A721&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276555A721%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T909&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T909%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380873%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fastening%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000094110%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=52785K811&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2252785K811%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T167&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T167%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-banding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76555A721&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276555A721%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T909&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T909%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvdf-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-028/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T167&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T167%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:41:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76555A721&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276555A721%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-clamps/material~300-series-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-clamps/specifications-met~astm-f2098&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/galvanized-steel-hex-nuts-for-astm-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucet-handle-pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-028&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-0781/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-coupling-dust-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5313593865679&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20clamps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5313593865679%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~citric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5313593865679&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20clamps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5313593865679%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003070174%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quad-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10483 pages (at 51 pages/min), scraped 232 items (at 1 items/min)
2026-01-04 02:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540942%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5419K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225419K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5101N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225101N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanized-steel-hex-nuts-for-astm-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-0781&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-118/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A287&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A287%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~citric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~hib9006&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5419K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225419K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-1285/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fda-listed-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326149%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-118&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A287&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A287%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fda-listed-leveling-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9613T165&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229613T165%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5419K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225419K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pedestrian-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-1285&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A287&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A287%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1350N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221350N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001546616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~1-13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10537 pages (at 54 pages/min), scraped 235 items (at 3 items/min)
2026-01-04 02:43:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5419K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225419K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pedestrian-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/for-use-with~cutting-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002260089%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-connect-hose-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A287&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A287%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gasket-cutting-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-194/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1139/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gasket-cutting-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-194&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~18-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feedthrough-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feedthrough-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feedthrough-usb-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000107533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1139&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~2-1-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~2-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-332/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1224/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9845T54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229845T54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~22-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1139/
2026-01-04 02:44:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/shaft-diameter~2-1-8-1/
2026-01-04 02:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000080481%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10585 pages (at 48 pages/min), scraped 236 items (at 1 items/min)
2026-01-04 02:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002279038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-348/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-type~round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-332&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6408K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226408K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1224&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9845T55&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229845T55%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shape~cross&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1224/
2026-01-04 02:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shape~straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-348&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-4062/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A199&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A199%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9845T55&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229845T55%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-4219/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-ports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A202&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A202%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-4062&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9845T55&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229845T55%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-4219&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pencil-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-type~unf-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10636 pages (at 51 pages/min), scraped 240 items (at 4 items/min)
2026-01-04 02:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-grip-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129835%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A138&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A138%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9845T55&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229845T55%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-mount-spray-nozzle-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pencil-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-703/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A139&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A139%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-7031/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/penetrant-corrosion-inhibitors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A138&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A138%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-115/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-703&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pentagon-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-7031&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-019&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542708%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=penetrant-corrosion-inhibitors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-024&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A138&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A138%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-1150&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531344%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feeler%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feeler%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001453326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~0-1150/
2026-01-04 02:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A259&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A259%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10687 pages (at 51 pages/min), scraped 241 items (at 1 items/min)
2026-01-04 02:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pentagon-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A138&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A138%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1821/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-with-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimpers/for-wire-cable-type~coaxial&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~1-55-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~1-563/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1895a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A259&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A259%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/drive-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968862%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1821&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~9-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5933689897561&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crowfeet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5933689897561%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-55-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-563&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1821/
2026-01-04 02:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1895a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A259&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A259%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~10-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533071%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530066%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1895a/
2026-01-04 02:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~2080/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~3-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/size~9-16/
2026-01-04 02:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10732 pages (at 45 pages/min), scraped 241 items (at 0 items/min)
2026-01-04 02:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95080A108&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295080A108%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A259&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A259%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~10-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~75-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=r389-17-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~2080&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~10-6mm/
2026-01-04 02:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~3-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~2080/
2026-01-04 02:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~18-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=raceway-outlet-box-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~75-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~3-5-mm/
2026-01-04 02:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3021a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~75-mm/
2026-01-04 02:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3021p/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/radius-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/feeler-gauges/thickness~0-6mm/
2026-01-04 02:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~18mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rack-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3021a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~18mm/
2026-01-04 02:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3021p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/radius-and-diameter-identifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=racks/component~complete-unit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/thread-size~1-12-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:48:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~3021a/
2026-01-04 02:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/thread-size~1-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10782 pages (at 50 pages/min), scraped 242 items (at 1 items/min)
2026-01-04 02:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~28-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~3021p/
2026-01-04 02:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%228402789064260%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=684483403398&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=racks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B684483403398%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002268912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8031429930803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8031429930803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333464%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/geared-trolleys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8031429930803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8031429930803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/thread-size~1-2-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8625A58&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228625A58%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~28-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8031429930803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8031429930803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449455%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=idler-drive-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/phenolic-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=geared-trolleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000076038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glass-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=radiant-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8920K204&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228920K204%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~5-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=phenolic-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~500t3q-cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519551%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10825 pages (at 43 pages/min), scraped 243 items (at 1 items/min)
2026-01-04 02:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8920K204&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228920K204%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glass-repair-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=radioactive-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~5-25mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~47&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~6-05-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~5-25mm/
2026-01-04 02:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/phillips-thread-forming-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~500t3q-cl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~47/
2026-01-04 02:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~558/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8920K204&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228920K204%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~7-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-repair-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~500t3q-cl/
2026-01-04 02:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~6-05mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fence-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=phillips-thread-forming-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-type~unf-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~558&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~6-05mm/
2026-01-04 02:49:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8920K204&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228920K204%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~657/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~7-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indexing-spring-plungers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129835%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~558/
2026-01-04 02:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/garment~arm-pad/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~9-3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/fabrication~cast/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~796/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~657&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fencing/fencing-component~diagonal-support-rod-tightener&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10874 pages (at 49 pages/min), scraped 243 items (at 0 items/min)
2026-01-04 02:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gouges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/garment~arm-pad&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~9-3mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~657/
2026-01-04 02:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/fabrication~cast&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3565957842449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fencing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3565957842449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002052585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=railing-bracket-bases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gowning-benches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~796&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~9-3mm/
2026-01-04 02:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grab-catches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001570595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:30 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3565957842449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fencing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3565957842449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002052585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fencing/fencing-component~diagonal-support-rod-tightener&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gouges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~796/
2026-01-04 02:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~1-1-4-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-use-on~chain/manufacturer~dupont/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gowning-benches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~1-7-8-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grab-catches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rails/component~top-slide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-molykote-br-2-plus-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-molykote-g-0010-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~1-1-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-chain-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948522430991&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948522430991%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002251944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=railway-track-aligners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/thread-size~1-1-4-8/
2026-01-04 02:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-160/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~1-7-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10921 pages (at 47 pages/min), scraped 243 items (at 0 items/min)
2026-01-04 02:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7550N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227550N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~4-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rain-bibs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/thread-size~1-7-8-12/
2026-01-04 02:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pin-connectors/number-of-poles~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~epx/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~12-0000-mm/diameter~12-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~5-8-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534818%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000077135%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550841%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-connectors/number-of-poles~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inspection-equipment&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~epx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/inserts/thread-size~5-8-11/
2026-01-04 02:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pin-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=instant-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~epx/
2026-01-04 02:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchet-breaker-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/tolerance-rating~undersized/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchet-cable-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~fcr/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/for-use-with~lp-gas-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulating-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/thread-size~m4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 10968 pages (at 47 pages/min), scraped 244 items (at 1 items/min)
2026-01-04 02:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ratchet-wrenches/performance~nonsparking-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/tolerance-rating~undersized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~fcr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ground-hydrants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/thread-size~m4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchet-wrenches/nonsparking-properties~nonsparking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~fcr/
2026-01-04 02:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~brass-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grounding-buses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:52:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dowel-pins/thread-size~m4/
2026-01-04 02:52:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ratchet-wrenches/nonsparking-properties~nonsparking/
2026-01-04 02:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/performance~electrically-insulating-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ground-hydrants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/performance~electrically-insulating-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roller-conveyors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~h2-55w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grounding-buses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-point-type~notched&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/performance~electrically-insulating&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=44655K943&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2244655K943%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/performance-properties~electrical-insulator&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-conveyors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~h2-55w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11014 pages (at 46 pages/min), scraped 244 items (at 0 items/min)
2026-01-04 02:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/insulation/performance~electrically-insulating/
2026-01-04 02:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-heat-shields&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/insulation/performance-properties~electrical-insulator/
2026-01-04 02:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~h2-55w/
2026-01-04 02:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hair-dryers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/class-x-plug-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roller-thrust-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~17-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-foam-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/half-masks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-diameter~0-625/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=raymond-die-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622687%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hair-dryers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/class-x-plug-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-thrust-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-017/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7195N27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227195N27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~1-ga-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=half-masks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222914945088166%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~19-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-diameter~0-625&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-0312/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-ga-/
2026-01-04 02:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~pr9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000101885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-017&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11059 pages (at 45 pages/min), scraped 246 items (at 2 items/min)
2026-01-04 02:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222914945088166%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~19-ga-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-0312&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~14-4v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamer-sets/blade-shape~straight/size-adjustability~adjustable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~18v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/drill-bit-size~19-ga-/
2026-01-04 02:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~pr9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-017&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525578%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552897%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7218065360791&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamer%20sets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7218065360791%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003681173%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552926%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/material~carbide/reamer-type~for-dowel-pin-holes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222914945088166%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~pr9/
2026-01-04 02:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jacks/signal-type~data/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525578%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-0312&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T601&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T601%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7218065360791&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamer%20sets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7218065360791%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003681173%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamer-sets/blade-shape~straight/size-adjustability~adjustable&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T05&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T05%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/carbide-reamers-for-dowel-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222914945088166%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jacks/application~data-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/specifications-met~astm-standard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T601&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T601%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=festoon-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handrail-bracket-bases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=festoon-air-hose-carriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reamers/carbide-reamers-for-dowel-pins/
2026-01-04 02:55:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/jacks/application~data-1/
2026-01-04 02:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002057174%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-088/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11112 pages (at 53 pages/min), scraped 247 items (at 1 items/min)
2026-01-04 02:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~3-7v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-0937/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T601&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T601%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handrail-bracket-bases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~11-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fff-machine-motors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~11-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-088&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T904&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T904%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-0937&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T601&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T601%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~12-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~11-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~11-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539043%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~6v-dc-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/shank-type~hex/reamer-type~for-hole-alignment/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000116036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000043753%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539043%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-0937&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~12-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2281T53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222281T53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7535N199&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227535N199%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~6-ga-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065593%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/hex-nut-shank-reamers-for-hole-alignment-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5482K81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225482K81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:56:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/drill-bit-size~6-ga-/
2026-01-04 02:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11163 pages (at 51 pages/min), scraped 250 items (at 3 items/min)
2026-01-04 02:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fh-0420-16-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2247T5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222247T5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reamers/hex-nut-shank-reamers-for-hole-alignment-7/
2026-01-04 02:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~61-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/system-of-measurement~inch/shank-type~round/reamer-type~for-taper-pin-holes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~14-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~0-09-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/material~high-speed-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~14-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001541084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jis%252fjcis-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/inch-size-round-shank-reamers-for-taper-pin-holes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001491673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~0-1-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hardware-for-toilet-and-urinal-partitions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~14-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reamers/inch-size-round-shank-reamers-for-taper-pin-holes/
2026-01-04 02:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~61-ga-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8620K66&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228620K66%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~14-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fh-832-24-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000062589%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:56:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/drill-bit-size~61-ga-/
2026-01-04 02:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~0-1w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hardware-for-toilet-and-urinal-partitions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-148/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2245T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222245T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/for-use-on~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/performance~extended-reach/blade-shape~angled/size-adjustability~adjustable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2281T56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222281T56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~0-1w/
2026-01-04 02:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11209 pages (at 46 pages/min), scraped 253 items (at 3 items/min)
2026-01-04 02:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fh-832-24-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0240&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929691%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003679602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hats/clothing-size~l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~19-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-148&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114633%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hazardous-location-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2281T56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222281T56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533306%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fhs-032-16-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114633%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0240&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hazardous-material-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hats/size~l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~19-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533306%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-148&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~23-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~1-1-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hats/size~l/
2026-01-04 02:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-location-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2281T56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222281T56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162498%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~12-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-material-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-221/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T151&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T151%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~23-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyed-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11255 pages (at 46 pages/min), scraped 254 items (at 1 items/min)
2026-01-04 02:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-gun-heating-elements/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K257&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K257%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2281T56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222281T56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 02:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~29-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000027663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~12-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-221&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~29-3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6414N28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226414N28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001607030%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-232/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-gun-heating-elements&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0770&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~29-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-221&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~29-3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-pipe-bending-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000049122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~29-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~500k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-232&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111528%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0770&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6414N32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226414N32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/performance~electrically-insulating-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T667&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T667%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-pipe-bending-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/manufacturer~master-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~29-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7030K64&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227030K64%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005316692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-232&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~31-3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11305 pages (at 50 pages/min), scraped 259 items (at 5 items/min)
2026-01-04 02:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002274327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-(frp)-extrusions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~14-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-rounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T156&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T156%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~31-3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=klip-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002274327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/grip-style~knurled-head/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0915&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~14w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-(frp)-rounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~2-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000080408%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134022%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~14w/
2026-01-04 02:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001593666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T681&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T681%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002274327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/grip-style~knurled&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~17-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134022%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0915&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 02:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 02:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heavy-duty-cable-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1070&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/knobs/grip-style~knurled/
2026-01-04 03:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001490349%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~11-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heavy-duty-piano-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~2-2-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002274327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000098412%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11352 pages (at 47 pages/min), scraped 262 items (at 3 items/min)
2026-01-04 03:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1732N281&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221732N281%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heavy-duty-cable-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000098412%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1070&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knuckle-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000056975%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~11-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heavy-duty-piano-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~2-2w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-polish&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rolling-platform-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~2-2w/
2026-01-04 03:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/end-type~toggle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~26-8-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~22-4-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~11-64&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~19-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=label-maker-cassettes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001491362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~28-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rolling-platform-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1365&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=label-printer-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~26-8w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/end-type~toggle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T773&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T773%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~19-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000137223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~26-8w/
2026-01-04 03:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/finish~powder-coated-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001945191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11402 pages (at 50 pages/min), scraped 264 items (at 2 items/min)
2026-01-04 03:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~28-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~19-32/
2026-01-04 03:01:14 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000137223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1365&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001945191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/end-type~toggle&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:01:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~28-mm/
2026-01-04 03:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/finish~zinc-yellow-chromate-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~6-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laboratory-cocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/finish~powder-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/anchor-installation-tools/anchor-type~female-threaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1515&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~no-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pins/finish~powder-coated/
2026-01-04 03:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1572&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~6-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~no-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/finish~zinc-yellow-chromate-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/tolerance-rating~oversized/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/installation-tools-for-female-threaded-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1515&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069294%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001617402%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~31-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~no-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547790%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:01:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pins/installation-tools-for-female-threaded-anchors/
2026-01-04 03:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~no-15/
2026-01-04 03:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~no-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-nut-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/oversized-dowel-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laptop-computer-workstations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~4-42-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~31w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~no-32/
2026-01-04 03:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11448 pages (at 46 pages/min), scraped 264 items (at 0 items/min)
2026-01-04 03:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547790%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pins/oversized-dowel-pins/
2026-01-04 03:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/box-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1785&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~31w/
2026-01-04 03:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=files/abrasive-material~ceramic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nut-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/material~plastic-1/material~ptfe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000093523%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~4-42w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7794418569789&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=files&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7794418569789%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531586%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547790%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/draw-locks-and-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1835&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~4-42w/
2026-01-04 03:02:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000093523%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1785&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/latches/draw-locks-and-latches/
2026-01-04 03:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/plastic-dowel-pins/material~ptfe-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/marine-pins/button-style~recessed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547790%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~4-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pins/plastic-dowel-pins/material~ptfe-plastic/
2026-01-04 03:02:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000129944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1835&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathe-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope/material~ptfe-fiber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~1-19-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-spot-paste/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/removable-bolt-anchors-for-concrete-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547342%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:10 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11498 pages (at 50 pages/min), scraped 264 items (at 0 items/min)
2026-01-04 03:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070131%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pins/removable-bolt-anchors-for-concrete-8/
2026-01-04 03:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-temperature-bellows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope/material~ptfe-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070131%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~1-19-64&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-spot-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-traction-overshoes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7090012887875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7090012887875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510299%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fill-caps/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-vacuum-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-temperature-bellows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2188&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/90-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114024%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screw-driven-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fill-caps/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-vacuum-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/system-of-measurement~inch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fill-caps/material~iron/
2026-01-04 03:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~90w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/color~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotameters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~141-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11547 pages (at 49 pages/min), scraped 264 items (at 0 items/min)
2026-01-04 03:04:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~90w/
2026-01-04 03:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fillers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000153325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~15-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2365&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2390&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotameters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092714%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131623%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006420%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-socket-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092714%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~15-1-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-use-on~neoprene-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006420%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2390&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=letter-jobbers-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~2-13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/honeycomb-composites/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lime-stain-removers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hooded-clothing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fillers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fasteners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2725&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157698%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lever-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031757%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=honeycomb-composites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/body-shape~hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hooded-clothing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11596 pages (at 49 pages/min), scraped 264 items (at 0 items/min)
2026-01-04 03:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:14 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031757%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2725&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-rotary-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/horizontal-lift-check-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/for-use-with~acetone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2990&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/round-head-sheet-metal-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/body-shape~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000108007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/round-knurled-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lift-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=horizontal-lift-check-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lift-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~acetone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000108007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2990&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-head-sheet-metal-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~80-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-knurled-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071204%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drain-cleaners/form~liquid-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/router-bits/for-use-on~hard-plastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifting-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liners/material~neodymium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11642 pages (at 46 pages/min), scraped 264 items (at 0 items/min)
2026-01-04 03:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifting-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/for-use-with~resin/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rowlock-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-level-transmitters/liquid-level-sensor-type~float&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977189960886&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=liners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977189960886%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-drain-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=router-bits/for-use-on~hard-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1299699905441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=liquid%20level%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1299699905441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003266252%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/screw-in-base-size~medium-standard-household&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:28 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977189960886&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=liners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977189960886%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liners/material~neodymium&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rtd-thermometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7101221864882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7101221864882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929888%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~resins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rowlock-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3966N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223966N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3515&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001577967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7101221864882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7101221864882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929888%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=router-bits/for-use-on~hard-plastic&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:06:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pipe-fittings/for-use-with~resins/
2026-01-04 03:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=littelfuse-type-216-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lighting-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/humidity-charts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rtd-thermometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:06:56 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3515&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/shape~adjustable-angle-elbow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/for-use-with~plating-solutions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=limit-switches/certification~csa-certified&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=limit-switches/environment~submersible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/shape~cross/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/shape~double-wye/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=humidity-charts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11689 pages (at 47 pages/min), scraped 265 items (at 1 items/min)
2026-01-04 03:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965241%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2001310163167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=limit%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2001310163167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002269638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2001310163167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=limit%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2001310163167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/shape~adjustable-angle-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3675&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3720&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/shape~cross&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/shape~double-wye&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/specifications-met~ifgc-compliant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber/material~rubber-1/material~rubber-over-buna-n-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber/material~rubber-1/material~sbr-recycled-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000072218%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2001310163167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=limit%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2001310163167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75145K92&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275145K92%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3675&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:44 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000072218%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3720&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4881K019&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224881K019%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/specifications-met~international-fuel-gas-code&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/material~rubber/material~recycled-rubber-over-buna-n-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/material~rubber/material~sbr-recycled-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-dampers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-jack-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2001310163167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=limit%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2001310163167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/thread-type~npt/pipe-size~1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:07:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pipe-fittings/specifications-met~international-fuel-gas-code/
2026-01-04 03:08:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rubber/material~rubber/material~recycled-rubber-over-buna-n-foam//
2026-01-04 03:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510818%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=load-rated-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber/shape~tapered-round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=62425T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2262425T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11736 pages (at 47 pages/min), scraped 267 items (at 2 items/min)
2026-01-04 03:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-jack-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2001310163167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=limit%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2001310163167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/thread-type~npt/pipe-size~1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=load-tensioners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydrogen-sulfide-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000156884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/shape~tapered-round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lock-cores&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/unions/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/material~phosphate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~10-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydrogen-sulfide-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~union-1/for-use-with~water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-legs/mount-type~hammer-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510179%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/finish~zinc-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ice-packs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:03 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510179%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/material~phosphate&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~10-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~12-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iec-motors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11779 pages (at 43 pages/min), scraped 268 items (at 1 items/min)
2026-01-04 03:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-guards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-feet/mount-type~hammer-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/filters/trade-size~10-12/
2026-01-04 03:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ice-packs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pipe-fittings/type~union/for-use-with~water/
2026-01-04 03:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rubber-feet/mount-type~hammer-in/
2026-01-04 03:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~union-1/shape~straight/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4380-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iec-motors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~12-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/immersion-separators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-tongs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/filters/trade-size~12-24/
2026-01-04 03:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~18-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/shape~straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4380&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-flange-hole-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4405&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-flares/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-hangers/finish~galvanized/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=immersion-separators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-recessed-bumpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reamers/reamer-diameter~0-4380/
2026-01-04 03:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000135062%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~18-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-flange-hole-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000135062%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4405&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:10:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/filters/trade-size~18-30/
2026-01-04 03:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-hangers/finish~galvanized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-flares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11824 pages (at 45 pages/min), scraped 268 items (at 0 items/min)
2026-01-04 03:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-recessed-bumpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/industrial-design-clay/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4570&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inert-gas-cocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5866438711872&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5866438711872%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockout-organizing-stations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000005286%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-insulation-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finger-brake-tape-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=industrial-design-clay&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:33 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000005286%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4570&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inert-gas-cocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-insulation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/for-use-on~trailer-air-brake-lines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finger-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/locks/for-use-on~trailer-air-brake-lines/
2026-01-04 03:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inline-mixers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/material~fabric-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-insulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-collars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-railing-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=locks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511101%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locksmiths-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inline-mixers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11873 pages (at 49 pages/min), scraped 268 items (at 0 items/min)
2026-01-04 03:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insect-killers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inspection-area-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-railing-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inspection-light-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-repair-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-40466&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-40481&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inspection-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~1200-mm/length~120-cm/length~1-2-m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insect-killers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inspection-area-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inspection-light-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-repair-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inspection-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-adhesive-primers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~1200mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~150-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:11:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rulers/length~1200mm/
2026-01-04 03:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulated-duct-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/overall-length~17-31-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-stanchions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~150-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11919 pages (at 46 pages/min), scraped 268 items (at 0 items/min)
2026-01-04 03:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulated-turrets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-threadlocker-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-duct-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-metal-filled-epoxy-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001584846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~17-31-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-stanchions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=long-nose-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-turrets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rulers/length~17-31-64/
2026-01-04 03:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~26-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~33-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loom-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-thread-reducers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loop-pipe-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-hose-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-thread-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~26-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loto-(lockout%252ftagout)-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~33-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-thread-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rulers/length~26-ft-/
2026-01-04 03:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-6875&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inverted-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rulers/length~33-ft-/
2026-01-04 03:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-thread-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 11967 pages (at 48 pages/min), scraped 268 items (at 0 items/min)
2026-01-04 03:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-7450&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iron-pipe-locknuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-profile-wire-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulon-lr/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-temperature-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inverted-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-machining-type~sawing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-pipe-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ix-industrial-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulon-lr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pivot-foot-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~1-5000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=louver-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000054408%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ix-industrial-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rust-inhibiting-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/j-style-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-sleeving&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pivot-foot-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-flow-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12017 pages (at 50 pages/min), scraped 268 items (at 0 items/min)
2026-01-04 03:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-suppressing-spray-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rust-inhibiting-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plank-decking/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=j-style-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-bar-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~21-5000-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-profile-head-tapping-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-profile-casters-(capacity-up-to-700-lbs)&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-profile-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-bench-tops/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079937%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plank-decking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fish-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/joint-connector-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sae-841-bronze-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/kerosene-centrifugal-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-bench-tops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/material~863-iron-copper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-key-stock/key-type~step&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=joint-connector-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fixed-height-workbench-legs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-841-bronze-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988755986406&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20key%20stock&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988755986406%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627916%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12065 pages (at 48 pages/min), scraped 268 items (at 0 items/min)
2026-01-04 03:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=receiver-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-conduit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kerosene-centrifugal-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-starts-stops-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-863-bronze-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988755986406&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20key%20stock&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988755986406%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627916%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-key-stock/key-type~step&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-machining-type~electrical-discharge-machining/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-corrugated-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/key-locking-plow-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-use-on~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-conduit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-pressure-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machinery-movers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnet-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-machining-type~edm-electrical-discharge-machining-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flags/message~army&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-corrugated-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=key-locking-plow-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-use-on~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/lubricant-type~assembly/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lubricants/for-machining-type~edm-electrical-discharge-machining-/
2026-01-04 03:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/high-pressure-oil-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9755626796405&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flags&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9755626796405%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002261817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-glass/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/kf-tees/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lubricants/for-use-on~stainless-steel/
2026-01-04 03:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/lubricant-type~powder/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222808248091965%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/u-s-state-territory~nebraska/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rectangular-tubing/material~garolite-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12109 pages (at 44 pages/min), scraped 268 items (at 0 items/min)
2026-01-04 03:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/lubricant-type~assembly-lubricant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1392K34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221392K34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-glass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kf-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=maintenance-tool-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/lubricant-type~powder-lubricant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lubricants/lubricant-type~assembly-lubricant/
2026-01-04 03:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flags/state-us-territory~nebraska&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rectangular-tubing/material~garolite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~boeshield-t-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lubricants/lubricant-type~powder-lubricant/
2026-01-04 03:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rectifiers/electronic-component-trade-number~gbj2502/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flags/state-us-territory~nebraska/
2026-01-04 03:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-shower-repair-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rectangular-tubing/material~garolite/
2026-01-04 03:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150505%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~delvac-1230&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-mesh-screens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/pipe-size~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=recycled-hdpe-boards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10215K23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210215K23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rectifiers/electrical-component-trade-number~gbj2502&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=recycling-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-shower-repair-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=manifolds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rectifiers/electrical-component-trade-number~gbj2502/
2026-01-04 03:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-mesh-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-pallets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12158 pages (at 49 pages/min), scraped 270 items (at 2 items/min)
2026-01-04 03:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/fitting-connection~quick-disconnect-clamp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-pipe-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flammable-liquids-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~mobilgear-600-xp-68&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-pressure-regulators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/laminated-steel-shim-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-quick-disconnect-hose-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-pallets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/fitting-connection~quick-clamp-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146215%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/connection-type~quick-disconnect-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-pipe-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masonry-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reducers/connection-type~quick-disconnect-clamp/
2026-01-04 03:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-pressure-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laminated-steel-shim-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-quick-disconnect-hose-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~boric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sandpaper/form~flap-disc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~rapid-tap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lanyard-attachments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sandpaper-drums/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/form~pad&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964962%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12204 pages (at 46 pages/min), scraped 272 items (at 2 items/min)
2026-01-04 03:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanged-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanged-ceramic-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~vacuoline-1409&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146192%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53505K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253505K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper/form~flap-disc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~rapid-tap&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lanyard-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper-drums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137369%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:28 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146192%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/form~pad&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2386623665772&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2386623665772%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanitary-barbed-tube-fittings/fitting-type~connector-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2096N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222096N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53505K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253505K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/fitting-connection~threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~1-21-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/flange-od~165-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lug-nut-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364557%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-barbed-tube-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000023438%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/pipe-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/flange-od~200-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53505K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253505K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lumber-crayons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4518K612&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224518K612%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~165mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12254 pages (at 50 pages/min), scraped 273 items (at 1 items/min)
2026-01-04 03:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flanges/flange-od~165mm/
2026-01-04 03:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~200mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lute-rakes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53505K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253505K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~3-3-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanitary-track-rollers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flanges/flange-od~200mm/
2026-01-04 03:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-anchors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=m16-glands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000068210%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~4-21-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=m20-gland&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4448T286&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224448T286%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071958%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-track-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~m1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-pencils/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanitary/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1747N455&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221747N455%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453952%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=92120A120&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2292120A120%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12303 pages (at 49 pages/min), scraped 276 items (at 3 items/min)
2026-01-04 03:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-pencils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/for-use-with~water-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-mount-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~m20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metals/fabrication~extruded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/thickness~3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/santoprene-rubber-sheet-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1062337176277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=metals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1062337176277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002248057%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms24693-c40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3490N141&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223490N141%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms24693-c56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/led-magnifiers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metalworking-shears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flanges/for-use-with~water/
2026-01-04 03:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/thickness~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=santoprene-rubber-sheet-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/led-ribbon-light-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screws/military-specifications-met~ms24693-c40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms51957-67/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001466678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screws/military-specifications-met~ms24693-c56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=led-magnifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/machine-screws/military-specifications-met~ms24693-c40/
2026-01-04 03:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms51959-50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/machine-screws/military-specifications-met~ms24693-c56/
2026-01-04 03:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12350 pages (at 47 pages/min), scraped 278 items (at 2 items/min)
2026-01-04 03:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=led-ribbon-light-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screws/military-specifications-met~ms51957-67&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circular-saw-blades-for-cast-iron/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/pipe-size~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barrels/band-color~reflective-orange-reflective-white/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/machine-screws/military-specifications-met~ms51957-67/
2026-01-04 03:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screws/military-specifications-met~ms51959-50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-flange-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/thread-type~nptf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000046129%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/machine-screws/military-specifications-met~ms51959-50/
2026-01-04 03:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-roll-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reflective-barrels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flap-wheel-arbor-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saws/circular-saw-blades-for-cast-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1723N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221723N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flap-wheel-arbors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:21:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/saws/circular-saw-blades-for-cast-iron/
2026-01-04 03:21:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flanges/thread-type~unf/
2026-01-04 03:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-socket-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/life-preservers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-threaded-pipe-fitting-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machinists-rulers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lifting-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12396 pages (at 46 pages/min), scraped 278 items (at 0 items/min)
2026-01-04 03:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1723N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221723N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/long-life-band-saw-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=refractory-insulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=life-preservers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-threaded-pipe-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machinists%27-rulers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulb-changing-poles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifting-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1723N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221723N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=refrigerant-pressure-testing-manifolds/hose-connection-thread-type~un-unf-sae-45&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saws/long-life-band-saw-blades-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7469886412935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=refrigerant%20pressure%20testing%20manifolds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7469886412935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129559%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sawzall-saw-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bars/material~epdm-neoprene-sbr-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulb-changing-poles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=661583884380&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B661583884380%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223158105478426%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flared-panel-mount-compression-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flared-tube-fitting-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1723N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221723N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=refrigeration-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1873K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221873K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4179A858&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224179A858%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sawzall-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sbr-foam-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lightning-conductors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flaring-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12446 pages (at 50 pages/min), scraped 279 items (at 1 items/min)
2026-01-04 03:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flashing-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1873K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221873K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastics/performance~high-strength-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulator-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/measurement-unit~kilonewtons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lightning-conductors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-belts/thickness~0-055&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-field-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1873K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221873K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastics/performance-properties~high-strength&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8024250994481&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flat%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8024250994481%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001466724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~fuel-gases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scales/scale~kn&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plastics/performance-properties~high-strength/
2026-01-04 03:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liquid-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9485T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229485T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179274%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/scales/scale~kn/
2026-01-04 03:23:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1873K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221873K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-eye-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scissor-lifts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~hydrogen-fluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plc-battery-packs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixer-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965331%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12495 pages (at 49 pages/min), scraped 280 items (at 1 items/min)
2026-01-04 03:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plier-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/living-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-head-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scissor-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A515&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A515%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-link-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plc-battery-packs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plier-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scrapers/blade-shape~half-round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scraping-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=living-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-shackles/finish~galvanized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screen-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/finish~galvanized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locking-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5607513703185&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flat%20shackles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5607513703185%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scrapers/blade-shape~half-round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/outlet-pipe-size~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screens/for-use-with~dairy/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scraping-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3815738403502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=magnets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3815738403502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3182438425377&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3182438425377%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screen-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~sulfur-hexafluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screens/for-use-with~dairy&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5607513703185&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flat%20shackles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5607513703185%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12543 pages (at 48 pages/min), scraped 281 items (at 1 items/min)
2026-01-04 03:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1120N52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221120N52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/magnet-grade~n38&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5254672608834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5254672608834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964932%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screw-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-bit-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motor-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3815738403502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=magnets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3815738403502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001989426%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3504N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223504N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A328&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A328%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5607513703185&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flat%20shackles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5607513703185%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/finish~corrosion-resistant-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/pipe-size~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/for-use-with~acetone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5607513703185&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flat%20shackles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5607513703185%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magni-coated-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relays/mounting-location~surface&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relays/switching-current~3-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-pvc-pipe-reducing-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/fitting-connection~loc-line/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-pipe-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-use-with~acetone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7088615684115&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=relays&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7088615684115%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002236973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7088615684115&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=relays&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7088615684115%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001631756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manhole-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plugs/for-pipe-size~1-4/
2026-01-04 03:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/material~titanium-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12593 pages (at 50 pages/min), scraped 284 items (at 3 items/min)
2026-01-04 03:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/power-source~manual/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/connection-style~loc-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5707N18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225707N18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-tool-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/manifolds/connection-style~loc-line/
2026-01-04 03:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/material~titanium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/thread-type~bspt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manometer-indicating-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/power-source~manual&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=float-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manual-swing-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plugs/material~titanium/
2026-01-04 03:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=manifolds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plumbing-fixtures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=remote-status-indicating-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multiple-flute-end-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plunge-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floating-joints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plungers/thread-size~8-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plumbing-fixtures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=narrow-mouth-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12642 pages (at 49 pages/min), scraped 285 items (at 1 items/min)
2026-01-04 03:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plunge-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floats/shape~90-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pneumatic-blowers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=replacement-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~gray-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2394922483006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=floats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2394922483006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screw-lifts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screw-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~11-16/
2026-01-04 03:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=markers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002197413%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2394922483006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=floats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2394922483006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floats/shape~90-elbow&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-tool-probes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reservoirs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pneumatic-dryers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screw-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screw-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=network-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/made-to-order-metric-drill-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-tool-probes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=resistance-soldering-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~no-0/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-dryers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marking-cones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/fitting-connection~socket-connect-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel/specifications-met~astm-b574&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=made-to-order-metric-drill-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12690 pages (at 48 pages/min), scraped 285 items (at 0 items/min)
2026-01-04 03:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel/specifications-met~astm-b865&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-base-trouble-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6971737856557&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nickel&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6971737856557%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/masks/performance~chemical-resistant-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~no-0&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6971737856557&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nickel&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6971737856557%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128640%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/finish~galvanized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/connection-style~socket-connect&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~no-0/
2026-01-04 03:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-machine-cleaning-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nipples/connection-style~socket-connect/
2026-01-04 03:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-contactors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-base-trouble-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirator-fit-test-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masks/application~chemical-resistant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~fuel-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/masks/application~chemical-resistant/
2026-01-04 03:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~medical-gas-blend-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pocket-protectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-contactors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/podiums/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirators/manufacturer-model-number~2096/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005756587%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nlgi-no-2-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-socket-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmetallic-cutting-band-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12739 pages (at 49 pages/min), scraped 285 items (at 0 items/min)
2026-01-04 03:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A419&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A419%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pocket-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=podiums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/for-manufacturer-model-number~2096&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-socket-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/for-use-with~abrasive-blasting-media&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/respirators/for-manufacturer-model-number~2096/
2026-01-04 03:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-control-mufflers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963062%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mandrel-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/mat-type~sanitizing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/manufacturer-model-number~60926&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/material~cork-fiber-reinforced-pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~1-3-8-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10615T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210615T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/manufacturer-model-number~7506n95&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001973993%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125120%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518667%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mandrel-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1509N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221509N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mauler-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518667%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/material~cork-fiber-reinforced-pvc&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-3-8-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12791 pages (at 52 pages/min), scraped 288 items (at 3 items/min)
2026-01-04 03:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125120%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nsf-ansi-standard-sinks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polishing-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polishing-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mds-filled-nylon/material-grade~nylon-6-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125120%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/niosh-approval~tc-84a-0601&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9990794930974&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mds%20filled%20nylon&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9990794930974%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320640%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polybutylene-manifolds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polishing-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polishing-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/respirators/niosh-approval~tc-84a-0601/
2026-01-04 03:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8554K38&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228554K38%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/marine-epoxies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125120%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polybutylene-manifolds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/marine-grade-moisture-resistant-hdpe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polycarbonate-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~3-4-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-controls/for-use-with~chlorine&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marine-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12837 pages (at 46 pages/min), scraped 289 items (at 1 items/min)
2026-01-04 03:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/marking-compasses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20controls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marine-grade-moisture-resistant-hdpe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polycarbonate-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~3-4-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mechanical-pencils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/marking-ribbon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marking-compasses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polycarbonate-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~0-781-32-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/masonry-chisels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squares/material~polycarbonate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449173%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=meeting-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marking-ribbon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polycarbonate-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~9-16-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masonry-chisels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester%252fvinyl-foam-mesh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polycarbonate-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/masterbatch/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12887 pages (at 50 pages/min), scraped 289 items (at 0 items/min)
2026-01-04 03:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~m27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~9-16-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyester-grade-industrial-laminate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:16 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~1-2-20-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=membrane-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~m48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449390%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masterbatch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~m27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester-grade-industrial-laminate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-2-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mechanical-jacks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-4-28-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~m48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333390%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyester/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mechanics-stools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nuts/thread-size~1-2-20/
2026-01-04 03:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334548%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453496%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mesh/mesh-size~3-5-3-5-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~7-8-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mechanical-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mechanics%27-stools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333387%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyethylene-drums/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-switches/food-industry-standard~3-a-certified-74-07&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453496%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractable-key-chains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~3-5-3-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12935 pages (at 48 pages/min), scraped 289 items (at 0 items/min)
2026-01-04 03:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/mesh/mesh-size~3-5-3-5/
2026-01-04 03:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plates/material~polyethylene-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractable-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-drums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453496%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/retractable-spring-plungers/mount-type~plate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-switches/pipe-size~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nw25-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-coated-lanyards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-foam-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyethylene-plastic-squares/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-hardware&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453496%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractable-spring-plungers/body-type~plate-mount&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-switches/pipe-size~2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-transmitters/pipe-size~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyethylene-round-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3688794005080&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=retractable%20spring%20plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3688794005080%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001944355%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-plastic-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5845522290168&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5845522290168%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-mesh-abrasive-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retrieving-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=return-grilles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 12985 pages (at 50 pages/min), scraped 289 items (at 0 items/min)
2026-01-04 03:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-ring-cord-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-bluing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-round-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/formulation~elastomer-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-bulk-storage-crates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~078/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-valves-for-toluene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-detectable-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-cups/performance~metal-detectable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-ring-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-detectable-hair-nets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/formulation~synthetic-elastomer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-ring-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reversing-motor-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sealants/formulation~synthetic-elastomer/
2026-01-04 03:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/for-use-with~toluene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~078&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-detectable-vacuum-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~109&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/for-use-with~brake-fluid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=339191585183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B339191585183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-filled-epoxies/manufacturer~devcon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rg-6%252fu-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rg-6%252fu-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13035 pages (at 50 pages/min), scraped 289 items (at 0 items/min)
2026-01-04 03:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flowmeter-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polypropylene-needle-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7220508746168&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=metal%20filled%20epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7220508746168%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002263064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/for-use-with~brake-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~268/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polypropylene-pipe-fitting-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polypropylene-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/o-rings/for-use-with~brake-fluids/
2026-01-04 03:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-needle-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~330/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~268&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=methyl-ethyl-ketone-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-pipe-fitting-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-ball-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~3525/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~330&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~3526/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polypropylene-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polypropylene-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096815%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13079 pages (at 44 pages/min), scraped 289 items (at 0 items/min)
2026-01-04 03:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~3525&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=obstruction-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1747A1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221747A1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ridgid-vf6000-vacuum-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~3526&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluke-1587-multimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143522%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74545A24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274545A24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/sealants/manufacturer-model-number~292i/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~420/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1700A218&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221700A218%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polysulfone-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigging-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigging-latch-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pem-style-screws/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-use-on~gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~420&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polysulfone-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093679%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dock-lights/light-technology~cfl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=right-angle-gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-pem-style-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13126 pages (at 47 pages/min), scraped 292 items (at 3 items/min)
2026-01-04 03:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~50172/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45855K102&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245855K102%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluorescent-light-bulb-shields&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluorescent-dock-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-embedded-thrust-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-special-pitch-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~50172&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-steel-hollow-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/sealants/manufacturer-model-number~292i/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~545/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyurethane-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~554/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyurethane-rounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=right-to-left-tape-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~545&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~574/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyurethane-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~292i&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigid-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103203%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~554&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sealants/manufacturer-model-number~292i/
2026-01-04 03:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyurethane-rounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~574&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1810A2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221810A2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13176 pages (at 50 pages/min), scraped 293 items (at 1 items/min)
2026-01-04 03:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~635/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluorosilicone-rubber-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~603/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45855K72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245855K72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~72/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~728-ns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micro-bnc-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~635&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~603&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112780%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~72&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oilites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~728-ns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132008%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-gauges/pipe-size~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131667%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flush-valve-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5131635916106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ring%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5131635916106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7610A12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227610A12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=open-end-hand-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1671N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221671N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2121A143&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222121A143%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flux-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13228 pages (at 52 pages/min), scraped 296 items (at 3 items/min)
2026-01-04 03:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micrometer-heads/manufacturer-model-number~350-354-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-gauges/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~90/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/micrometer-heads/manufacturer-model-number~350-354-30/
2026-01-04 03:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5131635916106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ring%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5131635916106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flux-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fly-milling-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3160A136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223160A136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micrometer-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~90&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-gauges/thread-size~9-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-gauges/thread-size~7-8-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fly-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141442%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5131635916106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ring%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5131635916106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5131635916106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ring%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5131635916106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/portable-temperature-controllers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micrometers/manufacturer-model-number~t436-1xfl-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3160A136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223160A136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7610A39&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227610A39%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3160A114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223160A114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=microphone-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3160A196&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223160A196%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5207874411218&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=micrometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5207874411218%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126316%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=portable-temperature-controllers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fly-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3160A136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223160A136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13281 pages (at 53 pages/min), scraped 301 items (at 5 items/min)
2026-01-04 03:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~es1901/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/grooved-base-size~midget/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlet-strips/certification~ul-listed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlet-strips/number-of-outlets~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3160A136&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223160A136%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-terminal-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~es1901&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7687249081189&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outlet%20strips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7687249081189%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091847%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7687249081189&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outlet%20strips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7687249081189%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530873%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/voltage~120v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/shape~rectangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=midget-grooved-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71515K17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271515K17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978812115307&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outlets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978812115307%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-service-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978812115307&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outlets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978812115307%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=force-gauges/display-type~analog&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~plastic-1/for-use-on~polyethylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5332402359200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=force%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5332402359200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001923636%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-gun-gas-diffusers/manufacturer-model-number~t40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~plastic-1/for-use-on~ptfe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-cords/iec-connector-type~c17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/manufacturer~detectamet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing-foam-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6171N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226171N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13330 pages (at 49 pages/min), scraped 302 items (at 1 items/min)
2026-01-04 03:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7095521672345&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mig%20gun%20gas%20diffusers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7095521672345%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323228%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~polyethylene-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=overloads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~ptfe-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cords/iec-style~c17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/manufacturer~detectamet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sealers/for-use-on~polyethylene-plastic/
2026-01-04 03:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sealers/for-use-on~ptfe-plastic/
2026-01-04 03:41:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/power-cords/iec-style~c17/
2026-01-04 03:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealing-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002238556%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=folding-benches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=folding-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-welding-liners/manufacturer-model-number~ez-feed-300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3986N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223986N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/diameter~0-147&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=folding-lid-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=garolite-angle-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-applicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1643606697087&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mig%20welding%20liners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1643606697087%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326779%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~12-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3986N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223986N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=97358A105&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2297358A105%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~3-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13381 pages (at 51 pages/min), scraped 303 items (at 1 items/min)
2026-01-04 03:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/output-voltage~24v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/mounting-location~rack/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bandages/bandage-features~metal-detectable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~12mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/color~red&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/for-use-in~metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3986N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223986N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/seals/for-shaft-diameter~12mm/
2026-01-04 03:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/output-voltage~24v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930175%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/mounting-location~rack&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=milled-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/seals/for-shaft-diameter~3-1-2/
2026-01-04 03:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/for-use-with~embossed-polypropylene-strapping/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-industry-bandages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5598907428381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5598907428381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3986N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223986N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5598907428381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5598907428381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380865%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/for-use-with~gasoline/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5598907428381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5598907428381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/output-voltage~24v-ac&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/for-use-with~isopropyl-alcohol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/military-specification~ms20426ad5-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~embossed-polypropylene-strapping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=milwaukee-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/for-use-with~r-22-refrigerant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~gasoline&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/width~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13427 pages (at 46 pages/min), scraped 304 items (at 1 items/min)
2026-01-04 03:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~isopropyl-alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/military-specifications-met~ms20426ad5-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464484%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/military-specification~ms20470ad8-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965701%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rivets/military-specifications-met~ms20426ad5-6/
2026-01-04 03:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~refrigerant-r-22&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2656T65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222656T65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/rivet-type~pin-drive/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/seals/for-use-with~refrigerant-r-22/
2026-01-04 03:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/military-specifications-met~ms20470ad8-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/material~mica/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/for-use-on~stainless-steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rivets/military-specifications-met~ms20470ad8-7/
2026-01-04 03:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mini-grabbers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/pin-drive-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/for-use-with~chemicals-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992232473973&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992232473973%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929868%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%225961331757996%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/material~mica&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13477 pages (at 50 pages/min), scraped 305 items (at 1 items/min)
2026-01-04 03:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seamless-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-electric-actuators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=97510A499&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2297510A499%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/seals/material~steel/
2026-01-04 03:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5070N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225070N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/precision-surface-benches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-milling-machines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seamless-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/press-in-captive-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/security-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parts-organizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gear-and-bearing-pullers/thread-size~5-8-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-surface-benches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivnuts/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2699428871106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gear%20and%20bearing%20pullers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2699428871106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-in-captive-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=security-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressboard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gorilla-glass/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glass/material~ceramic-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivnuts/thread-size~m12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13523 pages (at 46 pages/min), scraped 307 items (at 2 items/min)
2026-01-04 03:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pegboard-baskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauge-steam-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressboard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rivnuts/thread-size~m12/
2026-01-04 03:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass/impact-and-scratch-resistant-corning-gorilla-glass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rj-11-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass/material~ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rj45-bulkheads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-filled-nylon-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/glass/impact-and-scratch-resistant-corning-gorilla-glass/
2026-01-04 03:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauge-steam-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/glass/material~ceramic/
2026-01-04 03:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/force-gauges/measurement-unit~decanewtons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=perforated-metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-arms/manufacturer-model-number~10ia-l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/micrometers/manufacturer~mitutoyo/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9986989947299&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20arms&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9986989947299%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142242%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mitutoyo-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=force-gauges/scale~decanewtons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=phenolic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-cable-and-hose-carrier-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mitutoyo-series-101-micrometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/force-gauges/scale~decanewtons/
2026-01-04 03:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13573 pages (at 50 pages/min), scraped 307 items (at 0 items/min)
2026-01-04 03:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/self-priming-metering-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/self-tapping-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~magnets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-grippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-ready-grippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-priming-metering-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/formulation~pet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixing-propellers/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fork-lugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-tapping-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8656485639890&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mixing%20propellers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8656485639890%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-and-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7582T25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227582T25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=go-no-go-gauges/material~tool-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gpo3-fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-connectors/number-of-poles~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-safety-padding/for-robot-arm-manufacturer-series~gp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-removal-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4350123131503&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=go%20no%20go%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4350123131503%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510815%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pin%20connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7582T25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227582T25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13625 pages (at 52 pages/min), scraped 307 items (at 0 items/min)
2026-01-04 03:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobile-bin-box-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9993803950476&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20safety%20padding&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9993803950476%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096733%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobile-device-cases/for-use-with~iphone-8-plus-smartphones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-vessels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/mobile-device-cases/for-use-with~iphone-8-plus-smartphones/
2026-01-04 03:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sesamee-padlocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/garolite/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/frame-fittings/framing-type~flush-fit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-b6-stainless-steel-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7582T25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227582T25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-teach-pendant-cords/controller-manufacturer-model-number~rj3ib&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/for-use-on~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-vessels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-c-steel-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-teach-pendant-cords/manufacturer-equivalent-model-number~152029-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3733552981249&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20teach%20pendant%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3733552981249%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004861871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3733552981249&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20teach%20pendant%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3733552981249%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005188466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/electrically-conductive-garolite-glass-carbon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/flush-fit-framing-and-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:47:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7582T25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227582T25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4836N16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224836N16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/for-use-on~fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3822N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223822N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/framing/electrically-conductive-garolite-glass-carbon/
2026-01-04 03:48:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/framing/flush-fit-framing-and-fittings/
2026-01-04 03:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=modular-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/primers/for-use-on~bronze/
2026-01-04 03:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13675 pages (at 50 pages/min), scraped 308 items (at 1 items/min)
2026-01-04 03:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-teach-pendant-cords/manufacturer-equivalent-model-number~xgmf18137&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-teach-pendant-cords/manufacturer-equivalent-model-number~xgmf21686&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3733552981249&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20teach%20pendant%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3733552981249%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=momentary-access-safety-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3733552981249&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20teach%20pendant%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3733552981249%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150781%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3822N106&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223822N106%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=monel-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~molykote-g-n-metal-assembly-spray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/for-use-with~angle-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3822N106&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223822N106%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-tool-adapters-for-robot-machine-vision-camera-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~tool/manufacturer~abb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/abrasive-material~ceramic-alumina&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090150%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=freon-leak-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robotics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108937%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001532913%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-0156/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6968N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226968N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/for-use-on~bricks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-0313/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~6-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mop-sink-faucets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-0156inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13728 pages (at 53 pages/min), scraped 311 items (at 3 items/min)
2026-01-04 03:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mops/mop-head-durability~disposable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552792%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6968N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226968N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-0156inches/
2026-01-04 03:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-on~brick&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6861980511644&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6861980511644%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051135%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-0313inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4700A811&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224700A811%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4465A32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224465A32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grinding-wheels/for-use-on~brick/
2026-01-04 03:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-035inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-0313inches/
2026-01-04 03:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6968N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226968N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/grinding-wheel-shape~straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-035inches/
2026-01-04 03:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mortar-mixers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136050%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-041/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=12mm-diameter-round-and-10mm-diameter-square-mounting-rod-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4465A32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224465A32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motion-controllers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grippers/material~bronze-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:49:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6968N111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226968N111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=frl-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/material~plastic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=608445669459&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grippers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B608445669459%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13779 pages (at 51 pages/min), scraped 312 items (at 1 items/min)
2026-01-04 03:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grommets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4465A32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224465A32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-0938/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-041inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-alignment&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ground-handling-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-041inches/
2026-01-04 03:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=17-7-ph-stainless-steel-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grommets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-0938inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4465A32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224465A32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-end-linkages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grommets/material~stainless-steel/
2026-01-04 03:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-0938inches/
2026-01-04 03:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-ends/rod-end-type~bolt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rail-carriages/carriage-width~14-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-temperature-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=1922v363-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8204790604356&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rod%20ends&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8204790604356%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001934583%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-295/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mounting-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rail-carriages/carriage-width~48-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=funnels/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004049050%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grommets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rail-carriages/rail-width~28-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071582%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8461832346066&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=funnels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8461832346066%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4534N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224534N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13830 pages (at 51 pages/min), scraped 312 items (at 0 items/min)
2026-01-04 03:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=furnace-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-295inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~19-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000081058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6709K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226709K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grommets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guides/material~fiberglass-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-295inches/
2026-01-04 03:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6709K18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226709K18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~3-8-2/diameter~0-375/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9996658025836&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9996658025836%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003423545%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-4062/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-296875inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~2l180/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=h-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gum-foam-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-296875inches/
2026-01-04 03:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-035&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-375inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-4062inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/current~44-100-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-075&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-124739-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-375inches/
2026-01-04 03:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=2l180-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-4062inches/
2026-01-04 03:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527972%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13880 pages (at 50 pages/min), scraped 315 items (at 3 items/min)
2026-01-04 03:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-15795-821-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~0-44a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-866/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8893K122&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228893K122%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~300j6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~1-8-10-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~10-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fuses/current~0-44a/
2026-01-04 03:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hastelloy-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hdmi-splitters/nema-type~1-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001514240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-866inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=300j6-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16995-28-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-866inches/
2026-01-04 03:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~150-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-9-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hdmi-splitters/nema-style~1-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-75/diameter~1-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-151&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-153&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hdmi-splitters/nema-style~1-15/
2026-01-04 03:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-185&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001546119%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-28125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13932 pages (at 52 pages/min), scraped 316 items (at 1 items/min)
2026-01-04 03:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~11-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-75inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8893K157&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228893K157%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~1-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~350-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:53:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~1-28125inches/
2026-01-04 03:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-234&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A224&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A224%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~1-75inches/
2026-01-04 03:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524742%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542735%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~11-6millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~1-9-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~2-125/diameter~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A182&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A182%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~11-6millimeters/
2026-01-04 03:53:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/drive-size~1-9-16-1/
2026-01-04 03:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16997-84-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~11millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~2-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~15-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~392/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~14inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:53:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~11millimeters/
2026-01-04 03:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/drive-size~15-mm-1/
2026-01-04 03:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~2-65-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~2-125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~14inches/
2026-01-04 03:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~26-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~2-7-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~2-125inches/
2026-01-04 03:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 13978 pages (at 46 pages/min), scraped 319 items (at 3 items/min)
2026-01-04 03:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~22-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=392-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~3-3-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489990%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-build-surfaces/material~plastic-1/material~pei&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/drive-size~2-7-16-1/
2026-01-04 03:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~2-65millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-cleaning-filaments/diameter~1-750-mm/diameter~1-75-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003490024%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989271180099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20build%20surfaces&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989271180099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~2-65millimeters/
2026-01-04 03:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4815724927642&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20cleaning%20filaments&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4815724927642%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003934038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~22millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~4-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3697N26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223697N26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~9-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~1-65-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523372%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~22millimeters/
2026-01-04 03:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~1-15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-21043-4-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~5-05-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~4-25millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-65mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~10-4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~1-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~4-25millimeters/
2026-01-04 03:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=g-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~1-65mm/
2026-01-04 03:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14025 pages (at 47 pages/min), scraped 320 items (at 1 items/min)
2026-01-04 03:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=g-force-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~5-05millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001538450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~1-15-16/
2026-01-04 03:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~g23-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~5-05millimeters/
2026-01-04 03:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A385&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A385%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~6-15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/material~pett&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~15-mm/
2026-01-04 03:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~6-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/material~plastic-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8230254771998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20filaments&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8230254771998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=g23-2-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~2-7-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~11-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8230254771998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20filaments&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8230254771998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511607%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~6-15millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3462N29&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223462N29%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542620%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~6-8millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3483N3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223483N3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c275-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:55:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~6-15millimeters/
2026-01-04 03:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~3-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~2-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~6-8millimeters/
2026-01-04 03:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3d-printer-filaments/performance~wear-resistant-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~2-7-8/
2026-01-04 03:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14070 pages (at 45 pages/min), scraped 323 items (at 3 items/min)
2026-01-04 03:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/end-type~plain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~5-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-nozzles/body-finish~nickel-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/performance-properties~wear-resistant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~8inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~3-1-4/
2026-01-04 03:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971536404295&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971536404295%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128597%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/end-type~plain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-27183-12-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~60-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-1-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/3d-printer-filaments/performance-properties~wear-resistant/
2026-01-04 03:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~8inches/
2026-01-04 03:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-1-2-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3695N308&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223695N308%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001930121%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~2-1-4-1/
2026-01-04 03:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~5-mm/
2026-01-04 03:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~9-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-1-4-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~60-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-55-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-1-2-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms35206-221/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l130/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~60-mm/
2026-01-04 03:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gangable-potentiometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14115 pages (at 45 pages/min), scraped 324 items (at 1 items/min)
2026-01-04 03:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~no-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A246&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A246%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35206-221-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~9-16/
2026-01-04 03:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l130-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~no-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~t6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l490/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35275-225-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~no-27/
2026-01-04 03:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448476%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hexagonal-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539957%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A029&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A029%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~36-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l490-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-4941-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~m3-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14164 pages (at 49 pages/min), scraped 326 items (at 2 items/min)
2026-01-04 03:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/mount-type~screw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~m30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~4-45-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~36mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011043%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 03:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~4-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~36mm/
2026-01-04 03:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~m3-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3582N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223582N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gas-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~m30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543708%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~4-45mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51576-3-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shears/for-use-on~foil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~5-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~4-45mm/
2026-01-04 03:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:50 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~m3-5&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shears/for-use-on~hard-chain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~m30&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 03:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sheaves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/for-use-on~copper-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shears/for-use-on~foil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A322&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A322%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5847281553902&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5847281553902%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929555%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shears/for-use-on~hard-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gas-powered-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51958-59-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14212 pages (at 48 pages/min), scraped 327 items (at 1 items/min)
2026-01-04 03:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheaves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-use-on~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51959-1-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5847281553902&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5847281553902%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929906%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-use-on~copper/
2026-01-04 03:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3759A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223759A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51959-14-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shelving/component~standard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/material~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~460j10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~19-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~3-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~4-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000064455%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000032529%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shelving/component~standard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122650%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/material~leather&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=460j10-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8128528462812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8128528462812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002250117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A55&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A55%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 03:59:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/material~leather/
2026-01-04 04:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000149734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~1-1-4-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752A93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752A93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14264 pages (at 52 pages/min), scraped 331 items (at 4 items/min)
2026-01-04 04:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51968-8-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51971-7-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51972-2-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/for-use-on~composite-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shields/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~1-3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003433251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shim-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=msds-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1%2F4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221%2F4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shields/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4298A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224298A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-retrievers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1%2F4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221%2F4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95465A209&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295465A209%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shim-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9956488056472&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9956488056472%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/thread-size~1-4-28/
2026-01-04 04:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1%2F4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221%2F4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/belleville-spring-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14314 pages (at 50 pages/min), scraped 334 items (at 3 items/min)
2026-01-04 04:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~2-1-4-4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1%2F4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221%2F4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 500 Internal Server Error
2026-01-04 04:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hooks/mount-type~weld-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:17 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <500 https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1%2F4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221%2F4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true>: HTTP status code is not handled or not allowed
2026-01-04 04:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/belleville-spring-lock-washers/
2026-01-04 04:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/thread-size~2-1-4-4-1-2/
2026-01-04 04:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010804%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/signs/message~emergency-assembly-point/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-countersunk-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multipurpose-cutting-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/material~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~9-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mushroom-hook-and-loop&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/material~copper/
2026-01-04 04:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=muster-point-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/material~plastic/
2026-01-04 04:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-03/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l410/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/plastic-countersunk-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nail-in-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/for-use-with~natural-gas-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/plastic-countersunk-washers/
2026-01-04 04:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-019/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nameplate-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14359 pages (at 45 pages/min), scraped 334 items (at 0 items/min)
2026-01-04 04:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roll-on-stamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-03inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-115/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l410-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l780/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~natural-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roll-straighteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-03inches/
2026-01-04 04:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gaskets/for-use-with~natural-gas/
2026-01-04 04:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-019&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-06/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~19-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-115inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l780-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-077/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5v1180/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1149-cn332r-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-bearings/shaft-diameter~110-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-115inches/
2026-01-04 04:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-019&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3881238860388&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3881238860388%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002260759%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-06&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-296875inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5vx1080/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-077&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-38/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352c-08-6-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001462486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-296875inches/
2026-01-04 04:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001463621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-345/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352n-08-6-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14402 pages (at 43 pages/min), scraped 334 items (at 0 items/min)
2026-01-04 04:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5vx1080-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352c-08-6-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-38inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-and-links/roller-chain-trade-number~50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-345&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-38inches/
2026-01-04 04:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352n-08-6-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-and-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1820305007632&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20and%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1820305007632%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050345%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=natural-hard-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001455142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=6-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-attachment-links/roller-chain-trade-number~40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~1-5/id~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=60-degree-flares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2319372716381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20attachment%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2319372716381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~18-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506722%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497832%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=602-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-spring-clips/roller-chain-trade-number~25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/needles/needle-gauge~30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~11-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3412378825389&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20spring%20clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3412378825389%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000010068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2319372716381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20attachment%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2319372716381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14458 pages (at 56 pages/min), scraped 334 items (at 0 items/min)
2026-01-04 04:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~18-5inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-10-30-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=needles/needle-gauge~30-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50315K79&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250315K79%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~18-5inches/
2026-01-04 04:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~3-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/needles/needle-gauge~30-ga/
2026-01-04 04:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-diameter~1-4-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2319372716381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20attachment%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2319372716381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498422%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~3-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494918%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-6-20-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=90-watt-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5285K173&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225285K173%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5296K491&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225296K491%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-diameter~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2319372716381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20attachment%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2319372716381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-diameter~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50415K59&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250415K59%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001495788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:04:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rollers/roller-diameter~1-4/
2026-01-04 04:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shop-vacuums/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~7-625/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5285K173&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225285K173%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~8-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-diameter~72-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-diameter~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14507 pages (at 49 pages/min), scraped 337 items (at 3 items/min)
2026-01-04 04:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~7-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shop-vacuums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rollers/roller-diameter~20mm/
2026-01-04 04:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~7-625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507003%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5285K173&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225285K173%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~8-3125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-diameter~9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-bolts/thread-size~3-4-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-diameter~72mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~7-625inches/
2026-01-04 04:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5233K957&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225233K957%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~8-3125inches/
2026-01-04 04:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000048919%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rollers/roller-diameter~72mm/
2026-01-04 04:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-bolts/thread-size~m1-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5285K173&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225285K173%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~a48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l7-15-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-bolts/thread-size~3-4-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/shape~straight/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/showers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7944149739131&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7944149739131%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-bolts/thread-size~m1-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a48-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~11mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abec-1-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/shape~straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7944149739131&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7944149739131%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454712%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14555 pages (at 48 pages/min), scraped 338 items (at 1 items/min)
2026-01-04 04:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=showers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rollers/roller-width~11mm/
2026-01-04 04:06:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose-fittings/connection-style~barbed/for-use-with~water/
2026-01-04 04:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/u-s-state-territory~new-york/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~14-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-011/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~17-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/thread-type~npt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-alloy-400-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=new-york-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000170038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~20-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-011&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-alloy-718-rounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-cutoff-saws/manufacturer~makita-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139833%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-011/
2026-01-04 04:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000170038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9530664308861&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=abrasive%20cutoff%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9530664308861%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002274258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12975N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212975N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sight-glass-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-pressure-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14605 pages (at 50 pages/min), scraped 338 items (at 0 items/min)
2026-01-04 04:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-sponges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000170038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=india-stones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sight-glass-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/signal-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~clean-liquids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs-(schedule-40)-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000170038%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~butane-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/allen-screws/material~silicon-bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~cyclopropane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964626%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=signal-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~clean-liquids&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-114/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~f2b-012-rm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicon-bronze-allen-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~fb-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A658&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A658%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-132/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14657 pages (at 52 pages/min), scraped 339 items (at 1 items/min)
2026-01-04 04:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-114&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110559%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~solvents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ac-adapter-power-supplies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ac-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-114/
2026-01-04 04:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-133/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-133/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-132&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-137/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/pipe-schedule~160/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicone-inspection-hatches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-132/
2026-01-04 04:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/military-specification~an816-2j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-133&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-1330&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~12-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicone-rubber-edge-trim/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-1370&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-133/
2026-01-04 04:08:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-1330/
2026-01-04 04:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/schedule~160&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-inspection-hatches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/specifications-met~an816-2j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-1370/
2026-01-04 04:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~12-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-rubber-edge-trim&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nipples/specifications-met~an816-2j/
2026-01-04 04:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14701 pages (at 44 pages/min), scraped 340 items (at 1 items/min)
2026-01-04 04:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~22-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/thread-type~npsh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~12-mm/
2026-01-04 04:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/thread-type~nh-nst&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000166105%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~npl-205&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~22-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5365K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225365K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095820%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=romex-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nlgi-no-3-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrogen-welding-gas-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~22-mm/
2026-01-04 04:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~5-mm/
2026-01-04 04:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roof-curbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~pp204&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028901%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-guards/fitting-connection~quick-clamp-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-36llsp-clipper-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-4-1%252f2-clipper-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003916883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14754 pages (at 53 pages/min), scraped 341 items (at 1 items/min)
2026-01-04 04:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~sc-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9960504897412&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20guards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9960504897412%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~schb-208&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope/diameter~0-047&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002120407%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9960504897412&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20guards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9960504897412%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-guards/fitting-connection~quick-clamp-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7090012887875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rope&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7090012887875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-ucm36-clipper-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-cutters/performance~nonmagnetic-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/skirting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope/diameter~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7090012887875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rope&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7090012887875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000053987%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slatwall-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slatwall-panels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acme-mounting-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmagnetic-wire-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=skirting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~sth-14-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sleeve-retainers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slatwall-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slatwall-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/maximum-pressure~860-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acrylic-pvc-extrusions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14804 pages (at 50 pages/min), scraped 341 items (at 0 items/min)
2026-01-04 04:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-seals/for-use-with~oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-air-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeve-retainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slide-bolt-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/maximum-pressure-psi~860-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9785102052963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rope%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9785102052963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~conductivity&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~ucf205&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001732467%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slide-gates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~differential-vacuum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slide-bolt-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003916891%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-flow-sights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9785102052963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rope%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9785102052963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/drive-style~phillips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slide-gates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~differential-vacuum&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/for-use-in~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slide-tables/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000077072%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~line-width&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9785102052963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rope%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9785102052963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14851 pages (at 47 pages/min), scraped 341 items (at 0 items/min)
2026-01-04 04:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inspection-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096235%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sling-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/for-use-in~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slide-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1755T17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221755T17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9785102052963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rope%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9785102052963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:12:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/inserts/for-use-in~fiberglass/
2026-01-04 04:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/for-use-on~rubber-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mixing-nozzles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~porcelain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sling-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/material~nickel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/performance~flame-retardant-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slotted-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-tool-cutting-bits/shaft-diameter~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/mixer-nozzles-for-two-part-adhesive-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7479A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227479A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/material~nickel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/performance~flame-retardant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nsf%252fansi-standard-solenoid-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/insulation/for-use-on~rubber/
2026-01-04 04:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4313338843356&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rotary%20tool%20cutting%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4313338843356%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000137401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slotted-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nozzles/mixer-nozzles-for-two-part-adhesive-cartridges/
2026-01-04 04:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/insulation/material~nickel/
2026-01-04 04:13:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/insulation/performance~flame-retardant/
2026-01-04 04:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14899 pages (at 48 pages/min), scraped 342 items (at 1 items/min)
2026-01-04 04:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7479A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227479A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/unit-of-measure~n-mm-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/small-parts-picks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/smc-compressed-air-regulators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-tool-grinding-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/system-of-measurement~half-measure-inch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/color~black-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/system-of-measurement~half-measure-inch/
2026-01-04 04:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7479A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227479A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/system-of-measurement~mnm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=small-parts-picks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/junction-boxes/cover-material~stainless-steel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=smc-compressed-air-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/system-of-measurement~mnm/
2026-01-04 04:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotating-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:13:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7479A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227479A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~pg-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=junction-boxes/cover-material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~pg-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454988%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14947 pages (at 48 pages/min), scraped 342 items (at 0 items/min)
2026-01-04 04:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotator-ratchets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-type~metric-taper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-type~nh-nst&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/junction-boxes/cover-material~stainless-steel/
2026-01-04 04:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~3-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454937%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gearmotors/voltage~230v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7805K73&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227805K73%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~40-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7842K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227842K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9083566049828&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9083566049828%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553713%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5269K712&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225269K712%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~3-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~4-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9083566049828&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9083566049828%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553713%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gearmotors/voltage~230v-ac&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-belts/diameter~7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/soap/manufacturer-brand~gent-l-kleen/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power-source~add-a-motor/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~40-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/width~4-000mm/
2026-01-04 04:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6178916986877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=round%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6178916986877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550872%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~m90&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~1-12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000107666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-over-router-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-screwdriver-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soap/manufacturer~gent-l-kleen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:08 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000107666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~40-mm-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=additive-manufacturing-machines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 14994 pages (at 47 pages/min), scraped 345 items (at 3 items/min)
2026-01-04 04:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/soap/manufacturer~gent-l-kleen/
2026-01-04 04:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~1-312-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-standoffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nuts/thread-size~1-12/
2026-01-04 04:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-3-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-back-nylon-cable-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-312-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-back-vertical-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-back-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-round-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nuts/thread-size~1-312-18/
2026-01-04 04:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=routing-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rs-232-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rs-232-straight-through-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~3-8-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~plastic-1/for-use-on~nylon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inspection-mirrors/mirror-material~glass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451197%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=LEDs/bulb-shape-number~t3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15045 pages (at 51 pages/min), scraped 345 items (at 0 items/min)
2026-01-04 04:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~plastic-1/for-use-on~nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K702&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K702%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948839639468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=LEDs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948839639468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002057813%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~nylon-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-inspection-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930057%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~plastic-1/for-use-on~polyimide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8620K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228620K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adhesives/for-use-on~nylon-plastic/
2026-01-04 04:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/material~rubber-1/material~synthetic-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453388%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453496%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940607%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-base-type~wedge&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:39 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453496%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m48&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:16:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453388%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m42&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001931112%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape-number~g16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~85/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/shape~doughnut&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6932K53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226932K53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-type~npsl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320907%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/shape~tapered-rectangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002311290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8697K103&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228697K103%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~85&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adhesives/for-use-on~stainless-steel/
2026-01-04 04:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15097 pages (at 52 pages/min), scraped 348 items (at 3 items/min)
2026-01-04 04:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-guide-rail-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002311290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/shape~doughnut&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:17:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~85/
2026-01-04 04:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4429K121&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224429K121%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solenoids/for-use-with~liquid-argon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lockers/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-garden-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liners/material~fabric-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lithium-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockable-plug-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977189960886&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=liners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977189960886%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511101%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-quick-turn-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/for-use-with~liquid-argon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solenoids/shape~double-90-elbow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockers/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968165%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lockers/material~stainless-steel/
2026-01-04 04:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solid-rod-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50585K23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250585K23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~key-tite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-tip-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/shape~double-90-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glove-disposal-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15150 pages (at 53 pages/min), scraped 351 items (at 3 items/min)
2026-01-04 04:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-electrical-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-fire-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002248267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/color~blue-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solid-rod-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/shape~double-90-elbow&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvents/for-use-on~ceramic-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvents/for-use-on~plastic-1/for-use-on~abs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvents/for-use-on~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002191248%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sorting-trays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-403&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/color~off-white-fluorescent-orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~abs-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~131&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002191248%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-dividers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002248267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:18:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gloves/color~off-white-fluorescent-orange/
2026-01-04 04:18:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/solvents/for-use-on~ceramic/
2026-01-04 04:18:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/solvents/for-use-on~abs-plastic/
2026-01-04 04:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000101604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/solvents/for-use-on~bronze/
2026-01-04 04:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sorting-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15198 pages (at 48 pages/min), scraped 352 items (at 1 items/min)
2026-01-04 04:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002191248%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002248267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/thickness~0-028&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/thickness~0-04&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-598&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glow-in-the-dark-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/for-use-on~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~266&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464562%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001457391%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-twist-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002191248%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000057611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002248267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5283T42&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225283T42%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5409T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225409T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/for-housing-id~2-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K365&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K365%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-fixmaster-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-lb-8036&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rule-straightedges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/glue/for-use-on~bronze/
2026-01-04 04:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~363&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/for-housing-id~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~2-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjustable-wrenches/performance~electrically-insulating-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~14-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-grade-penetrating-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15247 pages (at 49 pages/min), scraped 355 items (at 3 items/min)
2026-01-04 04:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~378&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K519&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K519%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597733%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~7-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/formulation~calcium-sulfate-gypsum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-wrenches/electrical-properties~electrical-insulating&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000072054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/environment-1~food-and-beverage/lubricant-type~penetrating-lubricant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001611311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118427%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1923A56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221923A56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adjustable-wrenches/electrical-properties~electrical-insulating/
2026-01-04 04:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K434&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K434%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lubricants/environment-1~food-and-beverage/lubricant-type~penetrating-lubricant/
2026-01-04 04:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001611311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~28&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~3-6-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/screw-size~m38/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002892301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/hydraulic-oil-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~3-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjusting-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~dupont-non-stick-dry-film-lubricant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~lu-708-high-performance-dry&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~lubriplate-hydraulic-jack-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%227734283797274%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-screw-size~m38&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621473%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142752%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000085539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003762872%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15302 pages (at 55 pages/min), scraped 358 items (at 3 items/min)
2026-01-04 04:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119238%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K967&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K967%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spacers/for-screw-size~m38/
2026-01-04 04:21:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621473%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~3-m&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2256N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222256N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aerosol-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~458&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aerosol-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~08578&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~1000nf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121802%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~50-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=m5-stud-adjustable-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~918&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K452&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K452%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~920&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124145%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=made-to-order-shaft-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9408T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229408T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75285A12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275285A12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~50-ft&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047385%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-actuators/actuation-mechanism~air-rotate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9751K127&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229751K127%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/material~stainless-steel-2/material~321-stainless-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9751K128&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229751K128%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731925765182&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20actuators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731925765182%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002055663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~201&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15357 pages (at 55 pages/min), scraped 363 items (at 5 items/min)
2026-01-04 04:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9408T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229408T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/overall-length~58&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6508K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226508K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/material~stainless-steel/material~321-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~27010&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000063009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9408T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229408T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=offset-conduit-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511875%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082573%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-conditioner-coil-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6508K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226508K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1181N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221181N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/profile~raised-grid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9408T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229408T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-conditioning-filter-dryers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/electrical-connection~s-video/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6508K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226508K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-belleville-spring-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-bevel-gears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/washer-type~raised-grid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-bulk-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15410 pages (at 53 pages/min), scraped 365 items (at 2 items/min)
2026-01-04 04:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=s-video-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:23:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6508K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226508K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spanner-drive-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saddle-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~4sc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spanner-drive-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/sae-viscosity-grade~40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-compression-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~5091&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cylinders/bore-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/glue/manufacturer-model-number~4sc/
2026-01-04 04:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-5w-40-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/specialty-drain-waste-and-vent-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003408429%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4216247920660&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20cylinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4216247920660%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/specialty-fasteners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K37&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K37%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~krytox-gpl-105&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~lb-8013-high-purity-anti-seize&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=specialty-drain%2c-waste%2c-and-vent-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-halide-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15462 pages (at 52 pages/min), scraped 366 items (at 1 items/min)
2026-01-04 04:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=specialty-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cylinders/stroke-length~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~680&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K121&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K121%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4216247920660&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20cylinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4216247920660%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000089542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-hose-to-pipe-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spherical-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-dusters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~7150a-b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135983%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spherical-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~mobil-dte-heavy&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filter-frames/hvac-filter-trade-size~10-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filter-frames/hvac-filter-trade-size~14-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=66195A17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2266195A17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filter-frames/hvac-filter-trade-size~18-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080535%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9074576958623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filter%20frames&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9074576958623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002064190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9074576958623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filter%20frames&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9074576958623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002049210%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~8060&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~80628&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15516 pages (at 54 pages/min), scraped 368 items (at 2 items/min)
2026-01-04 04:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9074576958623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filter%20frames&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9074576958623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002066713%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093976%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091302%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091302%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~80628&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-glasses/performance~water-resistant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~ronex-mp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/hvac-filter-trade-size~13-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085309%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/hvac-filter-trade-size~14-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~tapmatic-natural&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-glasses/application~water-resistant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanding-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002066568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005043516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~wd-40-easy-reach&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090905%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/safety-glasses/application~water-resistant/
2026-01-04 04:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-breathers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085309%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-tank-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088090%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15568 pages (at 52 pages/min), scraped 369 items (at 1 items/min)
2026-01-04 04:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-breaking-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spline-l-keys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spline-screwdriver-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-thin-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/merv-filter-rating~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085309%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-wedges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-vacuum-breaking-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054792%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-fresheners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spline-l-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spline-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085309%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:26:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054792%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/merv-filter-rating~6&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-crosses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~qfs16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/specifications-met~fed-spec-a-a-3097&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ointment&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=salinity-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-gun-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15618 pages (at 50 pages/min), scraped 369 items (at 0 items/min)
2026-01-04 04:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spools/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002127296%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-178&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002363814%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75445A73&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275445A73%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spools/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494767%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=one-leg-wire-rope-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=one-way-clutches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scoops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=go%252fno-go-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spools/material~stainless-steel/
2026-01-04 04:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scrap-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=go-no-go-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494767%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screen-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=optical-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-319&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15671 pages (at 53 pages/min), scraped 370 items (at 1 items/min)
2026-01-04 04:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mirrors/shape~rectangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-51&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494767%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/for-use-with~ammonium-hydroxide-30-concentration&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496691%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-holding-hex-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gore-joint-sealant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grab-hooks/finish~powder-coated-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6828105263257&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mirrors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6828105263257%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8018988495419&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mixers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8018988495419%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984388%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K736&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K736%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6828105263257&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mirrors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6828105263257%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mirrors/shape~rectangle&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-paint/color~cummins-beige/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494767%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-aspirator-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grab-hooks/finish~powder-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-paint/color~fluorescent-red/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-paint/color~ford-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K736&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K736%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grab-hooks/finish~powder-coated/
2026-01-04 04:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~cummins-beige&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-902&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-834&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/water-aspirator-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlet-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497361%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~fluorescent-red&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~ford-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/mixers/water-aspirator-pumps/
2026-01-04 04:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002199046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K736&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K736%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K768&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K768%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002204117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15723 pages (at 52 pages/min), scraped 370 items (at 0 items/min)
2026-01-04 04:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K771&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K771%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002199319%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002199046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K736&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K736%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:29:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobilgrease-xhp-222-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002204117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprayers/for-use-with~urethane-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~1-76&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdriver-bit-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002199046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdriver-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/current-voltage~0-28-amp-100v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/current-voltage~0-8-amp-100v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501865%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002204117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprayers/for-use-with~urethane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978812115307&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outlets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978812115307%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002006158%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper/grit~360&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978812115307&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outlets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978812115307%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001998192%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K795&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K795%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~7-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002199046%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977152461181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977152461181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3741T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223741T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2386623665772&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sandpaper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2386623665772%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003150657%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3741T32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223741T32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002204117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15775 pages (at 52 pages/min), scraped 373 items (at 3 items/min)
2026-01-04 04:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4673A107&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224673A107%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms16624-retaining-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~7-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~14-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms16624-retaining-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977152461181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977152461181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-coils/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~7-64/
2026-01-04 04:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/drive-size~1-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~150-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16624-4043-retaining-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~14-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~17-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16624-4093-retaining-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/drive-size~1-16-1/
2026-01-04 04:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977152461181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977152461181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-coils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~16-to-120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/air-hose/length~14-ft-/
2026-01-04 04:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/outside-diameter-gauges/certificate-type~calibration-certificate-traceable-to-nist/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004099105%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1979T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221979T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~17-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977152461181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977152461181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5626K99&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225626K99%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~200-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outside-micrometers/manufacturer-model-number~103-922&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15822 pages (at 47 pages/min), scraped 377 items (at 4 items/min)
2026-01-04 04:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outside-diameter-gauges/certification~calibration-certificate-traceable-to-nist&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/air-hose/length~17-ft-/
2026-01-04 04:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622923%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8260587697623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outside%20micrometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8260587697623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135966%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/outside-diameter-gauges/certification~calibration-certificate-traceable-to-nist/
2026-01-04 04:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~0-7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-check-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35649-machine-screw-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-g-10-garolite-angle-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1979T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221979T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51964-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-glasses/lens-style~eyeglass-fit-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/size~0-7millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-8-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-tempered-stainless-steel-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/size~0-7millimeters/
2026-01-04 04:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334719%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352c-3-16-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-tempered-steel-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352n-4-20-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-tempered-stainless-steel-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15871 pages (at 49 pages/min), scraped 379 items (at 2 items/min)
2026-01-04 04:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=granite-parallels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334719%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352c-3-16-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-tempered-steel-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-lubrication-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-motors/mounting-location~hub&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352n-4-20-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sash-balances&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694030159591&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20powered%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694030159591%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010566%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334719%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oxyacetylene-tank-systems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sausage-packs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694030159591&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20powered%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694030159591%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010566%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-motors/mounting-location~hub&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saw-blade-welders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/for-use-on~stone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-winches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334719%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas1352c-08-12-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930162%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-saw-chains/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saw-sharpening-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas1352c-3-20-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/for-use-with~helium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nasm15795/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15926 pages (at 55 pages/min), scraped 379 items (at 0 items/min)
2026-01-04 04:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gravel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pa-system-amplifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~15-563/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saws/chain-saw-chains-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~plastic-1/for-use-on~polyimide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/saws/chain-saw-chains-6/
2026-01-04 04:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~10inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~titanium-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~19-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nasm-15795-805-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~15-563inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~2-625/length~2-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~polyimide-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~10inches/
2026-01-04 04:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930487%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saws/for-use-on~rubber-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~15-563inches/
2026-01-04 04:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing-slip-envelopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sealers/for-use-on~polyimide-plastic/
2026-01-04 04:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~2-72/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~19millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=661583884380&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B661583884380%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~2-625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~19millimeters/
2026-01-04 04:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alignment-lasers/mount-type~magnetic-base&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~2-625inches/
2026-01-04 04:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~2-72inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saws/manufacturer~skil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-terminal-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 15973 pages (at 47 pages/min), scraped 379 items (at 0 items/min)
2026-01-04 04:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alignment-locks/alignment-lock-type~tapered-round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/alignment-pins/performance~nonsparking-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1218312256577&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=alignment%20lasers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1218312256577%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010515%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alignment-locks/finish~titanium-nitride-tin-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~2-72inches/
2026-01-04 04:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=661583884380&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B661583884380%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4929613489696&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=alignment%20locks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4929613489696%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004212418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=neoprene-foam-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4929613489696&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=alignment%20locks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4929613489696%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001535325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4929613489696&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=alignment%20locks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4929613489696%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004212418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alignment-locks/alignment-lock-type~tapered-round&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alignment-pins/nonsparking-properties~nonsparking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4929613489696&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=alignment%20locks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4929613489696%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001535325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alignment-locks/finish~titanium-nitride-tin-coated&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sbr-rubber-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=allen-screws/material~glass-filled-nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~40-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/alignment-pins/nonsparking-properties~nonsparking/
2026-01-04 04:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7325958487577&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=allen%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7325958487577%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/material~polyester-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-alloy-200%252f201&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~krytox-1525&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~3inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~5-625/length~5-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-alloy-200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133318%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~40millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~krytox-gpl-106&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~3inches/
2026-01-04 04:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/mount-type~hammer-on/mount-type~tack/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16021 pages (at 48 pages/min), scraped 379 items (at 0 items/min)
2026-01-04 04:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7325958487577&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=allen%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7325958487577%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K9&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K9%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~40millimeters/
2026-01-04 04:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~5-625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/mount-type~hammer-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7325958487577&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=allen%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7325958487577%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alligator-belt-lacing/lacing-number~15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~5-625inches/
2026-01-04 04:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=secondary-containments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=security-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pads/mount-type~hammer-in/
2026-01-04 04:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3797964781943&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=alligator%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3797964781943%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/measurement-unit~carats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pail-and-drum-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7325958487577&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=allen%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7325958487577%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~lb-n-5000-high-purity-anti-seize&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/measurement-unit~tons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scales/scale~carats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-lines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~brown&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16072 pages (at 51 pages/min), scraped 380 items (at 1 items/min)
2026-01-04 04:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alphabetical-tabs-for-index-cards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/scales/scale~carats/
2026-01-04 04:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~fluorescent-light-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527274%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~fluorescent-pink&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scales/scale~tons-short-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum/material~aluminum-2/material~1200-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002194654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/scales/scale~tons-short-/
2026-01-04 04:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scales/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminized-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scalpels/scalpel-blade-trade-number~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrile-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3036288387516&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=scales&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3036288387516%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrile-rubber-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/material~aluminum/material~1200-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5559719586975&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=scalpels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5559719586975%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326306%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrile-rubber-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrile-rubber-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5069306377488&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5069306377488%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510070%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=36325A69&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2236325A69%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~molykote-g-0050-fm-white-ep&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/for-use-on~composite-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-alloy-6013&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16125 pages (at 53 pages/min), scraped 381 items (at 1 items/min)
2026-01-04 04:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128205%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bars/material~aluminum-2/material~5083-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~tapmatic-1-gold&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1445K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221445K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/for-use-on~composites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scopemeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9990216947512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20bars&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9990216947512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=noryl-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bronze-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/paint/for-use-on~composites/
2026-01-04 04:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-can-openers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scrapers/blade-material~rubber-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-crayons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-fitting-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-fitting-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screen-door-stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scrapers/blade-material~rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-mixing-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-6%252f6-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/scrapers/blade-material~rubber/
2026-01-04 04:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16180 pages (at 55 pages/min), scraped 382 items (at 1 items/min)
2026-01-04 04:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/id~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/id~2-187/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-hose-swivels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screens/shape~rectangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pallet-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pallet-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~2-187&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5254672608834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screens&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5254672608834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pallet-levelers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pallet-forks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-supply&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498230%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001495926%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/keyway-width~6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pallet-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-cutting-shears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/number-of-teeth~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/material~stainless-steel-2/material~300-series-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheet-metal-deburring-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498230%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-mount-emergency-stop-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16231 pages (at 51 pages/min), scraped 382 items (at 0 items/min)
2026-01-04 04:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/keyway-width~6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ofhc-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-mount-strobe-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sprockets/keyway-width~6mm/
2026-01-04 04:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498230%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/manufacturer-model-number~dwe43144&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-tracks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/number-of-teeth~48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panels/material~a588-alloy-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-switch-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grinders/manufacturer-model-number~dwe43144/
2026-01-04 04:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panels/material~hard-fiber-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498230%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-tank-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962166674953&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=panels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962166674953%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962166674953&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=panels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962166674953%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003432832%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9055N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229055N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-telescoping-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-weld-pipe-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shelving-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panic-bar-hardware&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527601%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16284 pages (at 53 pages/min), scraped 383 items (at 1 items/min)
2026-01-04 04:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shields/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paper/abrasive-material~zirconia-alumina/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~0-025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9956488056472&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shields&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9956488056472%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/roller-chain-trade-number~081/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shim-stock-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/abrasive-material~zirconium-oxide-ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=allen-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~0-063&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchor-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~0-025-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdriver-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-trade-size~081&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/paper/abrasive-material~zirconium-oxide-ceramic/
2026-01-04 04:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/drive-size~0-025-1/
2026-01-04 04:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:40:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sprockets/roller-chain-trade-size~081/
2026-01-04 04:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mountable-cable-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/christmas-tree-anchors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outside-micrometers/manufacturer-model-number~148-502&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper-wrap-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16332 pages (at 48 pages/min), scraped 383 items (at 0 items/min)
2026-01-04 04:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~11-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8260587697623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outside%20micrometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8260587697623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125150%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488376%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outside-micrometers/manufacturer-model-number~s909z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/mountable-cable-ties-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/thread-size~5-8-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oxyacetylene-torches/torch-handle-model-number~100fc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/plastic-drive-anchors-for-concrete&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8260587697623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outside%20micrometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8260587697623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109640%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/anchors/mountable-cable-ties-6/
2026-01-04 04:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8236106835344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oxyacetylene%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8236106835344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/anchors/plastic-drive-anchors-for-concrete/
2026-01-04 04:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/packing/material~glass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shock-struts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-collets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~ep14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~ep16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=particleboard-workbench-tops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8236106835344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oxyacetylene%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8236106835344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing/material~glass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~ep14-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~ep16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/packing/material~glass/
2026-01-04 04:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w172&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8236106835344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oxyacetylene%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8236106835344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/drive-size~ep14-1/
2026-01-04 04:42:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/drive-size~ep16-1/
2026-01-04 04:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004751821%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16386 pages (at 54 pages/min), scraped 383 items (at 0 items/min)
2026-01-04 04:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-bolts/thread-size~10-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-head-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminized-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004751821%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w172&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7944149739131&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shoulder%20bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7944149739131%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:42:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8236106835344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oxyacetylene%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8236106835344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~ip4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-grinders/for-use-with~flared-cup-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-head-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489964%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-head-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-plastic-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9993435663610&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=angle%20grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9993435663610%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967246%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pass-through-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w216&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pbt-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9993435663610&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=angle%20grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9993435663610%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967246%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-grinders/for-use-with~flared-cup-wheels&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-head-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pctfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-plastic-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:03 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w216&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pda-styli&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~t35&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint-markers/color~green-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sight-feed-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/specifications-met~astm-b209&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16436 pages (at 50 pages/min), scraped 383 items (at 0 items/min)
2026-01-04 04:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-style~asymmetrical/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=announcer-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5069306377488&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5069306377488%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/panels/material~rubber-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheel-dressers/for-use-with~toolroom-grinder-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=signal-generators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-markers/color~green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/for-drive-style~asymmetrical&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8649752436342&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheel%20dressers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8649752436342%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969006%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/paint-markers/color~green/
2026-01-04 04:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=peg-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/for-drive-style~asymmetrical/
2026-01-04 04:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panels/material~rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8649752436342&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheel%20dressers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8649752436342%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969006%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheel-dressers/for-use-with~toolroom-grinder-wheels&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~0-071/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pegboard-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pegboard-shelf-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~0-094/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/panels/material~rubber/
2026-01-04 04:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~0-157/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~0-071&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519599%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~0-0940&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antiseize-grease-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~0-071/
2026-01-04 04:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16487 pages (at 51 pages/min), scraped 383 items (at 0 items/min)
2026-01-04 04:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antiseize-lubricant-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4700A831&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224700A831%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~0-1570&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~0-0940/
2026-01-04 04:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=skate-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~0-1570/
2026-01-04 04:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pfa-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~1-16/
2026-01-04 04:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antistatic-sprays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-on~plaster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-on~tiles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=apple-ipad-compatible-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=perforated-panels-for-swing-out-panel-hinges-for-enclosures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~11-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeves/performance~abrasion-resistant-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940753%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=phenolic-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:44:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~11-mm/
2026-01-04 04:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=299320586602&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B299320586602%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3979A66&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223979A66%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~36-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/picks/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=phenolic-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=appliance-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~15-mm/
2026-01-04 04:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16540 pages (at 53 pages/min), scraped 384 items (at 1 items/min)
2026-01-04 04:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=phenolic-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/grit~2000/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3979A66&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223979A66%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arbor-mount-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~36-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=picks/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-butt-weld-pipe-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~ep18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sliding-door-hardware&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~36-mm/
2026-01-04 04:45:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/picks/material~fiberglass/
2026-01-04 04:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/grit~2000-grit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3979A66&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223979A66%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-cam-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/arbors/machine-taper-number~cat-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arbors/for-holding~sanding-pads-for-internal-and-irregular-surfaces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grinding-wheels/grit~2000-grit/
2026-01-04 04:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/grit~360/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-butt-weld-pipe-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~ep18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4531265455181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=arbors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4531265455181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slip-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:45:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3979A66&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223979A66%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-cam-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~ep18/
2026-01-04 04:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arbors/shank-type~cat-40-taper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slot-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/grit~360-grit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16588 pages (at 48 pages/min), scraped 384 items (at 0 items/min)
2026-01-04 04:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/arbors/shank-type~cat-40-taper/
2026-01-04 04:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-070/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pfa-pipe-unions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grinding-wheels/grit~360-grit/
2026-01-04 04:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~t1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~t4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=area-lights/light-technology~halogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pg36-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7748475325721&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=area%20lights&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7748475325721%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-07&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grip-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-089&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~t4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grip-strut-grating&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=14685K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2214685K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545776%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arrow-compatible-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~t4/
2026-01-04 04:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-electrical-panel-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=articulating-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/drive-size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-foil-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=phosphate-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-electrical-panel-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=photo-eye-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grippers/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488376%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16640 pages (at 52 pages/min), scraped 385 items (at 1 items/min)
2026-01-04 04:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=photographic-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-foil-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~ip3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grippers/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pick-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grippers/material~iron/
2026-01-04 04:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=assembly-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grips/material~wood-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/drive-size~ip3-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-193&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/hole-diameter~1-1-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3685722491177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3685722491177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128377%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/drive-size~ip3-1/
2026-01-04 04:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551451%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cordless-telephone-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:02 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3685722491177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3685722491177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128377%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grips/material~wood-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pillars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pillow-block-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551451%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-193&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/for-hole-diameter~1-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16691 pages (at 51 pages/min), scraped 385 items (at 0 items/min)
2026-01-04 04:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=atomizing-spray-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=at%26t-compatible-cordless-phone-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grommets/for-hole-diameter~1-1-16/
2026-01-04 04:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=attic-exhaust-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/military-specification~ms35275-204/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-and-lock-cantilever-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=auto-transformers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder/performance~conductive-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/military-specifications-met~ms35275-204&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-in-hex-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder/shape~wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-removal-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/for-station-manufacturer-model-number~wtcpn&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/military-specifications-met~ms35275-204/
2026-01-04 04:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/awls/performance~nonsparking-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:48:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solder/for-station-manufacturer-model-number~wtcpn/
2026-01-04 04:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/performance~conductive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax103/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~1-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/shape~coil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solder/performance~conductive/
2026-01-04 04:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pinch-valves/body-material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-vise-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16740 pages (at 49 pages/min), scraped 385 items (at 0 items/min)
2026-01-04 04:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=awls/performance~nonsparking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000030183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solder/shape~coil/
2026-01-04 04:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-wick&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/awls/performance~nonsparking/
2026-01-04 04:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132109%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/material~stainless-steel-2/opening-closing-action~self-close/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pinking-shears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pinch-valves/body-material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-shelving-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax61/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoid-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pinch-valves/body-material~brass/
2026-01-04 04:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~1-1-4-14-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/hole-diameter~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-self-closing-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax71/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax48-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-shoulder-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grommets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001670792%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-shelving-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax61-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax93/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-1-4-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~1-3-4-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax71-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-stair-treads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/thread-size~1-1-4-14/
2026-01-04 04:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16785 pages (at 45 pages/min), scraped 385 items (at 0 items/min)
2026-01-04 04:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~2-1-2-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-thimbles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~b106/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax93-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-3-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-stair-treads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-wood-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spanner-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/thread-size~1-3-4-12/
2026-01-04 04:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~2-1-2-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-thimbles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=b106-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=specialty-flat-head-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/thread-size~2-1-2-4/
2026-01-04 04:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spindle-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grounding-rings/motor-frame-size~nema-444t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scribers/tip-material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standard-harsh-environment-proximity-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6573339806813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grounding%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6573339806813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004993713%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scribers/manufacturer~mitutoyo&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=backer-rods/diameter~2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=splices/connects-to~hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scroll-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16833 pages (at 48 pages/min), scraped 385 items (at 0 items/min)
2026-01-04 04:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scribers/tip-material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8496026489774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=scribers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8496026489774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244689%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-harsh-environment-proximity-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7629365453761&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=backer%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7629365453761%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963492771234&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=splices&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963492771234%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002393955%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/scribers/tip-material~steel/
2026-01-04 04:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8566A24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228566A24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=badge-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bags/capacity~25-cu-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoffs/shape~angled/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-clasps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealant-primers/for-use-on~cpvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealant-primers/for-use-on~pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~350-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~500-lbs-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8652411469468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealant%20primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8652411469468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8652411469468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealant%20primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8652411469468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~25-cu-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bags/capacity-weight-~350-gal-/
2026-01-04 04:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/shape~angled&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:51:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bags/capacity-weight-~500-lbs-/
2026-01-04 04:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-plungers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bags/capacity-weight-~25-cu-ft-/
2026-01-04 04:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoffs/thread-size~m16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/fastener-head-type~rounded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8652411469468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealant%20primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8652411469468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16885 pages (at 52 pages/min), scraped 386 items (at 1 items/min)
2026-01-04 04:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/for-use-in~blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-load-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rails/rail-width~15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930279%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=baking-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ultra-thin-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~m16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8652411469468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealant%20primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8652411469468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=132998792534&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B132998792534%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000068438%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-bearings/high-load-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stanley-10-099-knives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-bearings/ultra-thin-ball-bearings-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8652411469468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealant%20primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8652411469468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:52:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ball-bearings/high-load-ball-bearings/
2026-01-04 04:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/for-use-on~viton-fluoroelastomer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~5-8-to-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-chain-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:52:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ball-bearings/ultra-thin-ball-bearings-6/
2026-01-04 04:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940632%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stanley-10-099-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/star-socket-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/id~49-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~10-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16931 pages (at 46 pages/min), scraped 386 items (at 0 items/min)
2026-01-04 04:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/for-shaft-diameter~2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-plunger-limit-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/for-shaft-diameter~5-8-to-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507813%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/for-shaft-diameter~2mm/
2026-01-04 04:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/id~7-8-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/for-shaft-diameter~5-8-to-1/
2026-01-04 04:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=star-socket-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~49mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cables/manufacturer~starrett-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-screw-nuts/thread-size~m15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/formulation~acetate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/id~49mm/
2026-01-04 04:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/formulation~cellulose-nitrate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7489222468978&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ball%20screw%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7489222468978%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=h900-temper-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/id~7-8/
2026-01-04 04:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131273%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=starrett-spc-cables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-valve-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:53:58 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7489222468978&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ball%20screw%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7489222468978%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-screw-nuts/thread-size~m15&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:54:02 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/formulation~acetate&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer~permatex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/static-control-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~24-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002261710%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 16983 pages (at 52 pages/min), scraped 386 items (at 0 items/min)
2026-01-04 04:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~1-2-to-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/static-control-ptfe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ballasts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~3-8-to-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~1-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003178366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~50-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~24-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003178323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K74&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K74%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002267771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/shaft-diameter~24-mm-1/
2026-01-04 04:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-ptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammer-driven-hole-punch-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squares/material~garolite-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angled-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~222&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-stainless-steel-tube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angled-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7580A84&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227580A84%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~2-3-8-lb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17038 pages (at 55 pages/min), scraped 387 items (at 1 items/min)
2026-01-04 04:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squares/material~garolite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acme-threaded-shafts/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/squares/material~garolite/
2026-01-04 04:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-butt-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7580A84&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227580A84%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~422&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~4707&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~2-3-8-lb&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-acme-threaded-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=banding-equipment&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123629%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-butt-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7580A84&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227580A84%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammers/manufacturer~milwaukee-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/manufacturer~milwaukee-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74985A67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274985A67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7352A19&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227352A19%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-cup-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~561&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:55:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7580A84&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227580A84%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/manufacturer~milwaukee&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-hand-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136665%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anti-backlash-ball-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hammers/manufacturer~milwaukee/
2026-01-04 04:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17089 pages (at 51 pages/min), scraped 389 items (at 2 items/min)
2026-01-04 04:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-drums/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-cup-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1011A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221011A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-metal-structural-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anti-extrusion-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-held-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-finishing-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-drums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~700&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~734&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-heat-exchangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~791&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132187%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stands/mount-type~magnetic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stands/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-finishing-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~ca4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7425A5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227425A5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75825A5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275825A5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962802582025&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stands&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962802582025%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962802582025&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stands&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962802582025%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-heat-exchangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115835%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7311A16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227311A16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75445A72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275445A72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17143 pages (at 54 pages/min), scraped 393 items (at 4 items/min)
2026-01-04 04:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-pipe-face-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/backing-type~plain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bars/material~cork&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-tube-benders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/battery-connection~threaded-receptacle-terminal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-bench-tops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-precision-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~ht-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998883551574&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=barriers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998883551574%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529519%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75445A72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275445A72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9990216947512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bars&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9990216947512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-pipe-face-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-rivet-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-connection-type~threaded-insert&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-rulers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-precision-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75445A72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275445A72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/batteries/battery-connection-type~threaded-insert/
2026-01-04 04:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~rubber-2/for-use-on~epdm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motors/motor-frame-size~nema-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-rivet-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-slide-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arc-welding-supplies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-rulers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5513810907834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stepper%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5513810907834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005415838%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75445A72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275445A72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~epdm-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17191 pages (at 48 pages/min), scraped 393 items (at 0 items/min)
2026-01-04 04:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~12d510&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5513810907834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stepper%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5513810907834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005415838%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motors/motor-frame-size~nema-24&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 04:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-slide-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sealers/for-use-on~epdm-rubber/
2026-01-04 04:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~rubber-2/for-use-on~viton-fluoroelastomer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106517%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stopper-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hangers/material~foam-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~15-5103-41500&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N94&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N94%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 04:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~3gb280-f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~viton-fluoroelastomer-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109926%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hangers/material~foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing-gum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sealers/for-use-on~viton-fluoroelastomer-rubber/
2026-01-04 04:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-wire-cloth/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2171N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222171N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strap-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~56703&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:58:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hangers/material~foam/
2026-01-04 04:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~2-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099230%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~3-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-wire-cloth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17239 pages (at 48 pages/min), scraped 396 items (at 3 items/min)
2026-01-04 04:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/for-shaft-diameter~1/
2026-01-04 04:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hard-hat-visors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~2-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=structural-plastics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~co100p3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/for-shaft-diameter~2-7-16/
2026-01-04 04:59:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/for-shaft-diameter~3-4/
2026-01-04 04:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/for-use-with~propylene-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140627%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~lubricant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/for-shaft-diameter~3-1-4/
2026-01-04 04:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stone-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6745K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226745K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984502%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-threaded-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stop-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~salt-solutions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~propylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hastings-triplet-magnifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=suction-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stone-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179283%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 04:59:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/for-use-with~propylene/
2026-01-04 05:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stoppers/mount-type~adhesive-back/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984502%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stop-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17290 pages (at 51 pages/min), scraped 398 items (at 2 items/min)
2026-01-04 05:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stoppers/shape~convex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stoppers/mount-type~threaded-stud-and-threaded-hole&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/large-object-limit-switches/environment~hazardous/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179283%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~elb0320&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stoppers/mount-type~adhesive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984502%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/stoppers/mount-type~threaded-stud-and-threaded-hole/
2026-01-04 05:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elevator-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stoppers/shape~convex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977840261548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977840261548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-location-large-object-limit-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179283%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977840261548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977840261548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308428%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977840261548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977840261548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stoppers/mount-type~adhesive&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:00:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984502%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-mount-cabinet-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elevator-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stops/mount-type~hook-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/speakers/environment~hazardous/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/emergency-wash-stations/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/shaft-diameter~1-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:00:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179283%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~2-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stops/mount-type~threaded-body/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barbed-end-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17335 pages (at 45 pages/min), scraped 398 items (at 0 items/min)
2026-01-04 05:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops/mount-type~hook-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-location-speakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=emergency-wash-stations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~gp3600gr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962004834368&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962004834368%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010630%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/shaft-diameter~2-7-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops/mount-type~threaded-body&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-caps/connection-style~barbed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133662%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:01:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962004834368&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962004834368%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010630%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops/mount-type~hook-on&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:01:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/shaft-diameter~2-7-8-1/
2026-01-04 05:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962004834368&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962004834368%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/certification~c-ul-listed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/end-caps/connection-style~barbed/
2026-01-04 05:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N119&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N119%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switch-designation~dpst-1no-1nc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/environment~submersible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002254507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962004834368&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962004834368%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops/mount-type~threaded-body&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/cut-style~t-slot/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=secondary-containment-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~lfp18650&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~lr621&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/for-use-on~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/for-use-on~carbon-fiber-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/industry-designation~dpst-1no-1nc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101257%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/for-use-on~copper-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/cut-style~t-slot&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/industry-designation~dpst-1no-1nc/
2026-01-04 05:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17385 pages (at 50 pages/min), scraped 399 items (at 1 items/min)
2026-01-04 05:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7604K211&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227604K211%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/for-use-on~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/for-use-on~carbon-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switch-designation~dpdt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=security-tapping-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/for-use-on~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/end-mills/for-use-on~aluminum/
2026-01-04 05:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8789A16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228789A16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/end-mills/for-use-on~carbon-fiber/
2026-01-04 05:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003016264%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-exchangers/shell-side-pipe-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/end-mills/for-use-on~copper/
2026-01-04 05:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/for-use-with~beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~0-03/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9849942329479&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20exchangers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9849942329479%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151745%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switching-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/for-use-with~ethylene-glycol-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~nic0683&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3613K26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223613K26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~p-200scs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090131%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:02:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-03&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103761%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~ethylene-glycol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N97&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N97%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001722946%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17436 pages (at 51 pages/min), scraped 402 items (at 3 items/min)
2026-01-04 05:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7685K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227685K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/strainers/for-use-with~ethylene-glycol/
2026-01-04 05:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~12-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-cleaning-drive-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8832A47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228832A47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-drilling-drywall-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-dumping-hoppers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-set-insert-tips/thread-size~10-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~12mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-set-insert-tips/thread-size~2-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~2-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-set-insert-tips/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4102345180745&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20set%20insert%20tips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4102345180745%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/end-mills/mill-diameter~12mm/
2026-01-04 05:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~sp373&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4102345180745&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20set%20insert%20tips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4102345180745%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031867%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4102345180745&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20set%20insert%20tips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4102345180745%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-locking-thumb-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099498%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-priming-gear-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~sr721sw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/street-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~tl-2150-c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epdm-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17487 pages (at 51 pages/min), scraped 405 items (at 3 items/min)
2026-01-04 05:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001728813%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104229%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4102345180745&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20set%20insert%20tips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4102345180745%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132726%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099498%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/color~safety-yellow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7604K118&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227604K118%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=street-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=serrated-flange-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epdm-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4102345180745&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20set%20insert%20tips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4102345180745%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099498%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/color~safety-yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=servomotors/motor-frame-size~nema-34&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-contacts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/set-screws/military-specification~ms51963-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002190490%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4012873219423&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=servomotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4012873219423%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001573704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=set-screw-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4102345180745&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20set%20insert%20tips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4102345180745%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heaters/heater-type~heat-wand&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:04:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099498%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:04:59 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002190490%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/color~safety-yellow&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-in-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/manufacturer-model-number~dp460ns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/manufacturer-model-number~dp420/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9258402983590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heaters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9258402983590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969541%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/struts/bracket-type~surface/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strut-channel-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/framing-type~strut-channel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=set-screws/military-specifications-met~ms51963-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17537 pages (at 50 pages/min), scraped 407 items (at 2 items/min)
2026-01-04 05:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/set-screws/military-specifications-met~ms51963-2/
2026-01-04 05:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stub-to-stub-turnbuckles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~dp460ns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beaded-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~dp420&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/strut-channel-framing-component~surface-bracket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/manufacturer-model-number~mr-2000/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/strut-channel-framing-component~washer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/strut-channel-framing-component~tube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150215%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2427054843101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2427054843101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002149698%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2427054843101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2427054843101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078108%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2427054843101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2427054843101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123204%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stub-to-stub-turnbuckles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heavy-duty-razor-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7467A66&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227467A66%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7467A25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227467A25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~mr-2000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/beam-clamps/for-suspending~threaded-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heavy-duty-shelf-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sewer-pipe/material~pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beam-tongs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beams/shape~t-bar&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17588 pages (at 51 pages/min), scraped 409 items (at 2 items/min)
2026-01-04 05:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/adapter-sleeve-trade-number~h-2307&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beam-clamps/for-suspending~threaded-rod&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/for-use-with~air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7461582032409&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sewer%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7461582032409%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510407%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981281014267&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=beams&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981281014267%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313298%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003865574%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/beam-clamps/for-suspending~threaded-rod/
2026-01-04 05:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shackles/thickness~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977791246039&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tees&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977791246039%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2426K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222426K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-balls/material~low-carbon-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/er-70s-6-welding-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003865574%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/adapter-sleeve-trade-number~h-2307&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9493236633548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shackles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9493236633548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001456292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1615424320354&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1615424320354%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ethernet-cable-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/for-use-with~fuel-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ethernet-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/pipe-material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96455K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296455K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977791246039&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tees&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977791246039%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/support-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977791246039&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tees&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977791246039%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002191436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nuts/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=er-70s-6-welding-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ethernet-cable-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/exhausters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nuts/thread-size~m110&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ethernet-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4849K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224849K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/expanding-shank-rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454097%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17637 pages (at 49 pages/min), scraped 411 items (at 2 items/min)
2026-01-04 05:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=support-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-plungers/mount-type~press-fit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhausters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/surface-protectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4849K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224849K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tension-cables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expanding-shank-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/surge-protectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/current~20-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-plungers/body-type~press-fit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4849K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224849K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~rg-59-u/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8457081369444&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ball%20plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8457081369444%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surge-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~16003-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/current~20a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-seals/shaft-diameter~1-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137487%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-cords/serial-port-interface~rs-232/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/extension-cords/current~20a/
2026-01-04 05:08:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4849K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224849K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:08:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1157601946191&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shaft%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1157601946191%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/industry-designation~rg-59-u&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sweat-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17685 pages (at 48 pages/min), scraped 411 items (at 0 items/min)
2026-01-04 05:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sweat-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/extension-cords/industry-designation~rg-59-u/
2026-01-04 05:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-screw-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~1605-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/industry-designation~rs-232&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-screws/system-of-measurement~inch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074414%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/extension-cords/industry-designation~rs-232/
2026-01-04 05:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sweat-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-seals/shaft-diameter~45-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sweat-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7965558737631&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ball%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7965558737631%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~2203-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermocouples/thermocouple-sensor-connection~bluetooth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/length~7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1157601946191&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shaft%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1157601946191%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002274508%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115044%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=950656771113&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thermocouples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B950656771113%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466489%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~22211&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switch-shrouds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7128N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227128N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115844%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermowells/fitting-connection~quick-clamp-1/food-industry-standard~3-a-certified-74-06&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-transfers/system-of-measurement~inch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6886432728818&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thermowells&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6886432728818%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139257%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9042733030405&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ball%20transfers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9042733030405%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17736 pages (at 51 pages/min), scraped 412 items (at 1 items/min)
2026-01-04 05:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switch-shrouds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534857%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3016-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~30204&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-locking-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-protector-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extensions/square-drive-size~1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extractors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3200-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-038&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switch-designation~3pst/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extensions/square-drive-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~52-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539130%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extractors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-extensions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6004-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9996540530177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9996540530177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000098738%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150954%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A278&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A278%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090349%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/industry-designation~triple-pole-single-throw-3pst-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-059&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eyebolt-eyelets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17788 pages (at 52 pages/min), scraped 413 items (at 1 items/min)
2026-01-04 05:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/switches/industry-designation~triple-pole-single-throw-3pst-/
2026-01-04 05:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-061&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554950%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-070/diameter~0-07/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-0785/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-073&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6201-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolt-eyelets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-precision-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6206-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113543%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-081/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-07inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-0785inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A264&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A264%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-07inches/
2026-01-04 05:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145372%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-0785inches/
2026-01-04 05:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113543%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-081inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~5-7a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/component~ball-nut&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-09375inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-081inches/
2026-01-04 05:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fabric-glue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6302-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/switches/switching-current~5-7a/
2026-01-04 05:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17836 pages (at 48 pages/min), scraped 414 items (at 1 items/min)
2026-01-04 05:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002232611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-09375inches/
2026-01-04 05:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113543%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/face-masks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6315-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002232611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/component~ball-nut&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/face-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~634-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fabric-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eyebolts/thread-size~2-1-2-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003921170%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113543%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=face-masks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=face-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6700-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fan-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-weld-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/mounting-location~wall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~2-1-2-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threadlocking-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivel-end-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~10-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fan-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/eyebolts/thread-size~2-1-2-4/
2026-01-04 05:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=throttle-needle-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17881 pages (at 45 pages/min), scraped 414 items (at 0 items/min)
2026-01-04 05:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/mounting-location~wall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6906-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-end-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~10-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002266240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thru-hull&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119346%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thrust-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tie-down-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000155461%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-197&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~18-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002266240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000015130%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~1-2-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tie-wrap-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~25-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~15-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002266240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-209&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001605380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-2-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/swivels/material~bronze/
2026-01-04 05:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17932 pages (at 51 pages/min), scraped 414 items (at 0 items/min)
2026-01-04 05:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~1-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552493%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~25-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~1-7-8-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~27-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449455%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002266240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A214&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A214%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-277&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~1-7-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~27-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=time-delay-controls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526200%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/swivels/thread-size~1-7-8-12/
2026-01-04 05:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000063689%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A214&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A214%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~33/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A192&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A192%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~36-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=19555K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2219555K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~5-8-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/thread-size~m30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/swivels/thread-size~5-8-11/
2026-01-04 05:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~33&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-316&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 17979 pages (at 47 pages/min), scraped 415 items (at 1 items/min)
2026-01-04 05:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A214&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A214%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~36-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=19555K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2219555K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~m30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557303%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~1200xxh200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000037998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A197&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A197%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A214&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A214%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=19555K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2219555K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-3594/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~lm12749-lm12710/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~1260xh300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~1540xh200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=19555K54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2219555K54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/syringes/capacity~1-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005439223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005438401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~40&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-3594inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~lm12749&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~5-8/diameter~0-625/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringes/capacity-weight-~1-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18027 pages (at 48 pages/min), scraped 416 items (at 1 items/min)
2026-01-04 05:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tires&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:15:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-3594inches/
2026-01-04 05:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/bearing-trade-number~lm12749/
2026-01-04 05:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/drive-style~square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/drive-style~tri-groove/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/syringes/capacity-weight-~1-ml/
2026-01-04 05:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/finish~anodized/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-7188/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linear-bearing-housings/housing-type~flange-mount-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/finish~nickel-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/drive-style~square&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/drive-style~tri-groove&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-625inches/
2026-01-04 05:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~anodized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-7188inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-984&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/flange-mounted-linear-bearing-housings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000020582%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157063%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~nickel-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550239%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-7188inches/
2026-01-04 05:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~zinc-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542451%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:15:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/flange-mounted-linear-bearing-housings/
2026-01-04 05:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrier-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-1875/diameter~1-3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18071 pages (at 44 pages/min), scraped 416 items (at 0 items/min)
2026-01-04 05:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-15-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542451%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-042&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-4-1/diameter~0-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-1875inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~0-80/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496338%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-0938&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031850%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~1-1875inches/
2026-01-04 05:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-46875inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-5/diameter~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542451%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96511A116&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296511A116%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499231%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/material~steel/
2026-01-04 05:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slot-hardware/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~1-46875inches/
2026-01-04 05:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~0-80&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000036509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073039%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A009&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A009%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~1-1-2-6-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333448%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542451%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~adhesive-surface-mounting-strip/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slot-hardware&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-readers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~1-2-20-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~1-2-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~hinge/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~1-1-2-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18119 pages (at 48 pages/min), scraped 418 items (at 2 items/min)
2026-01-04 05:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333448%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~adhesive-surface-mounting-strip&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/thread-size~1-1-2-6/
2026-01-04 05:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~1-2-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~1-2-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/t-slots/t-slot-framing-component~adhesive-surface-mounting-strip/
2026-01-04 05:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=towing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-2508&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~1-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~hinge&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/thread-size~1-2-20/
2026-01-04 05:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454167%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333448%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~11-16-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494925%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/t-slots/t-slot-framing-component~hinge/
2026-01-04 05:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/thread-size~8-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A316&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A316%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/thread-size~m36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333448%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tractor-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~11-16-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-3145&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A316&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A316%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/thread-size~m36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~15-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18168 pages (at 49 pages/min), scraped 418 items (at 0 items/min)
2026-01-04 05:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=traffic-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slotted-framing-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526265%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~11-16-27&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trailer-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A316&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A316%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/thread-size~m36&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8813A86&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228813A86%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~3-8-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~7-16-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans-with-lids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-5313&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A316&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A316%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-5469&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~7-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499386%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-566&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~m24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~2-985&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A514&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A514%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trim-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18218 pages (at 50 pages/min), scraped 419 items (at 1 items/min)
2026-01-04 05:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522573%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K298&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K298%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95365A631&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295365A631%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=truss-head-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/take-apart-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-7344&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K298&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K298%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-8135&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-834&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497108%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~3-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~3-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=take-apart-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497361%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A697&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A697%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K298&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K298%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:19:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K649&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K649%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A481&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A481%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~3-875inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fastening-tape/tape-type~light-blocking/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/for-use-with~ethylene-glycol-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~3-8millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18269 pages (at 51 pages/min), scraped 423 items (at 4 items/min)
2026-01-04 05:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K298&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K298%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fitting-gaskets/tube-od~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~3-875inches/
2026-01-04 05:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tank-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~3-8millimeters/
2026-01-04 05:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-1235&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/faucets/for-manufacturer~sloan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1768933986141&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fitting%20gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1768933986141%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002214533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/faucets/for-manufacturer~symmons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/tape-type~light-blocking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-use-with~ethylene-glycol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498648%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-185&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=43315K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2243315K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002248271%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tube-fittings/for-use-with~ethylene-glycol/
2026-01-04 05:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-2656&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~sloan&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~symmons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002147633%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~2-1-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thicknesses-included~0-0005-silver/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99815A029&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299815A029%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-376&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:01 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002147633%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~sloan&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-3775&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~symmons&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-508-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493689%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18319 pages (at 50 pages/min), scraped 425 items (at 2 items/min)
2026-01-04 05:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-334&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502118%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~2-1-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-0005-silver-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-508-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494999%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494631%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tanks/capacity-weight-~2-1-gal-/
2026-01-04 05:21:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/feeler-gauges/thickness~0-0005-silver-/
2026-01-04 05:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-508&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~3-3-8-qt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-024/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-508mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-028/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502322%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~7-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-626&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~1-508mm/
2026-01-04 05:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~3-3-8-qt-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~6-3-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thicknesses-included~0-050-clear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~8-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-028&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tanks/capacity-weight-~3-3-8-qt-/
2026-01-04 05:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464562%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18363 pages (at 44 pages/min), scraped 425 items (at 0 items/min)
2026-01-04 05:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~6-3-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~9-4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/for-use-with~butane-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-050-clear-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~8-2millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-straights/mounting-location~through-wall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tanks/capacity-weight-~6-3-gal-/
2026-01-04 05:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/feeler-gauges/thickness~0-050-clear-/
2026-01-04 05:22:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~8-2millimeters/
2026-01-04 05:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957058458968&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20straights&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957058458968%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/for-use-with~butane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~9-4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-to-pipe-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tanks/for-use-with~butane/
2026-01-04 05:22:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/fabrication~cold-rolled&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tanks/capacity-weight-~9-4-gal-/
2026-01-04 05:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/fabrication~molded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/for-use-with~water-based-solutions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~9millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feet/thread-size~1-12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002275085%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002264988%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:22:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~9millimeters/
2026-01-04 05:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~11-9997-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2150T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222150T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/for-use-with~water-based-solutions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499664%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/thread-size~1-12-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-1-2-6-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18409 pages (at 46 pages/min), scraped 426 items (at 1 items/min)
2026-01-04 05:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~deionized-water-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964590%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~methyl-ethyl-ketone-mek&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/feet/thread-size~1-12-1/
2026-01-04 05:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/material~brass/
2026-01-04 05:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967804%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~pharmaceuticals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1933N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221933N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/felt-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~14-01-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-1-2-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/thread-size~1-1-2-6/
2026-01-04 05:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/markers/tip-type~felt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tap-magic-xtra-thick-cutting-fluids/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=felt-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~14-01mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~150-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~2-1-2-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~14-01mm/
2026-01-04 05:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=felt-tip-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~2-1-2-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-insulation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-magic-xtra-thick-cutting-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~150-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454244%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~2-1-2-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~150-000mm/
2026-01-04 05:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~2-m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 504 Gateway Time-out
2026-01-04 05:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A014&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A014%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:08 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <504 https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true>: HTTP status code is not handled or not allowed
2026-01-04 05:24:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/thread-size~2-1-2-4/
2026-01-04 05:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fep-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-insulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18454 pages (at 45 pages/min), scraped 427 items (at 1 items/min)
2026-01-04 05:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~5-m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~2-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/for-use-with~sodium-hypochlorite-bleach/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten/hardness-rating~hard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~9-64-41-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-squares/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fep-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614204%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9312103427271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tungsten&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9312103427271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381019%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~5-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-0015&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449205%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614204%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~2-m&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/for-use-with~bleach&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:39 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9312103427271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tungsten&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9312103427271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381019%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten/hardness-rating~hard&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614823%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/for-use-with~hydraulic-fluid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/ferrules/for-use-with~bleach/
2026-01-04 05:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~0-718/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614823%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~5-m&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tapered-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-254&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~1-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/for-use-with~hydraulic-fluid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~0-968/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~0-718&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tapered-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-5002&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18503 pages (at 49 pages/min), scraped 428 items (at 1 items/min)
2026-01-04 05:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001584985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~1-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502279%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~0-968&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5349K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225349K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001629781%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499664%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sharkbite-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4759K219&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224759K219%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-flute-end-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/pipe-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-bolts/specifications-met~ansi-mss-sp-58-type-24-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4759K219&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224759K219%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-bolts/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001604843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9450455444526&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=u%20bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9450455444526%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002344590%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7195N16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227195N16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shears/for-use-on~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/pipe-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9450455444526&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=u%20bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9450455444526%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/specifications-met~astm-standard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18552 pages (at 49 pages/min), scraped 429 items (at 1 items/min)
2026-01-04 05:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4759K219&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224759K219%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5847281553902&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shears&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5847281553902%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929691%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001631031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/ferrules/material~stainless-steel/
2026-01-04 05:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-1-16-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5305K793&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225305K793%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:28 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/pipe-size~1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-1-4-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/specifications-met~astm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4759K219&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224759K219%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~28-076-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/ferrules/specifications-met~astm/
2026-01-04 05:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=universal-joints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-1-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-1-4-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-4-56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheaves/pulley-type~mounted&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-5-8-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~28-076mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=utility-knife-blades/for-cutting~sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4216289581347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sheaves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4216289581347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974352%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~28-076mm/
2026-01-04 05:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1387700418558&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=utility%20knife%20blades&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1387700418558%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930493%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-4-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~32-05-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18601 pages (at 49 pages/min), scraped 431 items (at 2 items/min)
2026-01-04 05:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~32-01-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-(frp)-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~4-025-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~1080-h8m-50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-backup-power-supplies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~32-05mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-(frp)-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282210%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4-025mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~32-05mm/
2026-01-04 05:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-charger-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~4-025mm/
2026-01-04 05:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~42-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~5-01-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-tool-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-grooves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497422%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497419%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filaments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shelving/component~hanging-track&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shelving-angle-brackets/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18652 pages (at 51 pages/min), scraped 431 items (at 0 items/min)
2026-01-04 05:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-tool-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~55-06-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8128528462812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shelving&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8128528462812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002240651%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~6-100-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-type~npt/pipe-size~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filaments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507865%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-hose-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1938A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221938A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shelving-angle-brackets/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-hydraulic-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-type~npt/pipe-size~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shelving-angle-brackets/material~stainless-steel/
2026-01-04 05:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~6-100mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/files/shape~convex-concave/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fillers/for-joining~cpvc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tarp-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fillers/for-use-on~canvas/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~6-100mm/
2026-01-04 05:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-tube-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~8-900-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=files/shape~convex-concave&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-joining~cpvc-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tarp-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-use-on~canvas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493069%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filter-media/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18699 pages (at 47 pages/min), scraped 432 items (at 1 items/min)
2026-01-04 05:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7794418569789&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7794418569789%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fillers/for-joining~cpvc-plastic/
2026-01-04 05:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96977A327&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296977A327%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7794418569789&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7794418569789%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=files/shape~convex-concave&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearing-adapter-sleeves/shaft-diameter~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filter-media&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~543-783-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/multi-slotted-shims/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tee-nuts/nut-type~rivet-mount/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/unthreaded-spacers/material~polypropylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-3135&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96977A327&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296977A327%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003986248%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000025595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/for-shaft-diameter~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/press-fit-drill-bushings-with-head/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/multi-slotted-shims&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/polypropylene-unthreaded-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-nuts/nut-type~rivet-mount&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:29:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearing-adapter-sleeves/for-shaft-diameter~1-1-2/
2026-01-04 05:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96977A327&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296977A327%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/performance~self-retaining/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/multi-slotted-shims/
2026-01-04 05:30:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/polypropylene-unthreaded-spacers/
2026-01-04 05:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000025595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/press-fit-drill-bushings-with-head-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18747 pages (at 48 pages/min), scraped 432 items (at 0 items/min)
2026-01-04 05:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-6895&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%229583504945332%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96977A327&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296977A327%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/self-retaining-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000025595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibration-control-routing-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8492A129&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228492A129%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/self-retaining-washers/
2026-01-04 05:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000025595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/material~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibration-damping-mats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fire-alarms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-021&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-09&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vinyl-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tees/material~copper/
2026-01-04 05:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-315&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=walkways&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001467155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18801 pages (at 54 pages/min), scraped 433 items (at 1 items/min)
2026-01-04 05:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-781&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-8135&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/uss-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~12-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=warmers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084870%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flange-head-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flange-locknuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/uss-washers-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flange-mounted-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~12-8mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~15-04-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flange-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shipping-boxes/corrugated-box-strength-rating~44-ect&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flange-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/uss-washers-8/
2026-01-04 05:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:31:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~12-8mm/
2026-01-04 05:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shipping-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7456722113519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shipping%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7456722113519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002259235%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flange-mounted-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/flange-od~1-984/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-04mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18847 pages (at 46 pages/min), scraped 433 items (at 0 items/min)
2026-01-04 05:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/flange-od~13-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-051-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~15-04mm/
2026-01-04 05:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000135761%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~1-984&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~18-051-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/for-use-with~nitrogen-gas/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000096724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/flange-od~13-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wear-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000123003%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092799%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges-for-sulfuric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/for-use-with~chlorine/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50485K864&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250485K864%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~nitrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=44685K175&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2244685K175%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/pipe-size~5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/flanges/for-use-with~nitrogen/
2026-01-04 05:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=webbing/buckle-type~ratchet-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~chlorine&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermometers/certificate-type~calibration-certificate-traceable-to-nist/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shop-vac-906-71-vacuum-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1538835581167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=webbing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1538835581167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/flanges/material~brass/
2026-01-04 05:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~20-08-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~20-04-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18896 pages (at 49 pages/min), scraped 435 items (at 2 items/min)
2026-01-04 05:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-bolts/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermometers-with-nist-certificate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flat-point-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142656%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~20-08mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flatbed-truck-tie-downs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-torches/torch-series-number~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-bolts/thread-size~m2-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-bolts/thread-size~5-8-11-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~20-08mm/
2026-01-04 05:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7140856590719&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7140856590719%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-point-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7944149739131&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shoulder%20bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7944149739131%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shoulder-bolts/thread-size~5-8-11-1/
2026-01-04 05:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flex-head-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread/finish~ptfe-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flatbed-truck-tie-downs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7140856590719&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7140856590719%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-torches/torch-series-number~18&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51576-38/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-brushes/bristle-flexibility~flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flex-head-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-22/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread/finish~ptfe-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flexible-pipe-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18941 pages (at 45 pages/min), scraped 435 items (at 0 items/min)
2026-01-04 05:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-screws/military-specifications-met~ms51576-38&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3913099702390&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3913099702390%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-end-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-lock-hose-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shoulder-screws/military-specifications-met~ms51576-38/
2026-01-04 05:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-screws/specifications-met~ms51575-22&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3913099702390&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3913099702390%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread/finish~ptfe-coated&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=winding-hose-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-pipe-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shoulder-screws/specifications-met~ms51575-22/
2026-01-04 05:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floats/for-use-with~hydrochloric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-lock-hose-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floats/for-use-with~plating-solutions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=window-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~3-253&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~30-04-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~3-455&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000042606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floats/for-use-with~hydrochloric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~18-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000061560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shunt-carbon-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floats/for-use-with~plating-solutions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2394922483006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2394922483006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~30-04mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561473%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2394922483006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2394922483006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965241%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=side-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3748K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223748K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~30-04mm/
2026-01-04 05:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 18991 pages (at 50 pages/min), scraped 435 items (at 0 items/min)
2026-01-04 05:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8070T18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228070T18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50195K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250195K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sight-glass/for-use-with~water-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~4-5-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/finish~ptfe-coated/color~blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000123435%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000150564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/component~ball-screw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sight-lamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sight-glass/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~45-04-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~46-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/finish~blue-ptfe-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sight-glass/for-use-with~water/
2026-01-04 05:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000053128%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000027312%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:35:59 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/component~ball-screw&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/threaded-rods/finish~blue-ptfe-coated/
2026-01-04 05:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=signal-horns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~5-755&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~1-8-41-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sjo-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19041 pages (at 50 pages/min), scraped 438 items (at 3 items/min)
2026-01-04 05:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=signs/accident-prevention-message-type~slip-and-fall-prevention&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000053128%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=skate-wheels/wheel-diameter~1-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5161877211177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=signs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5161877211177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeves/material~titanium-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~5-8-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=signs/message~fire-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8350698174345&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=skate%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8350698174345%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001923443%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=299320586602&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B299320586602%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000053128%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-8-41-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5161877211177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=signs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5161877211177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002242763%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-valves/valve-type~ball/for-use-with~oxygen/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2290T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222290T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~5-8-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5758T37&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225758T37%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/threaded-rods/thread-size~5-16-24/
2026-01-04 05:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000053128%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/for-use-with~oxygen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-stops/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2290T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222290T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=339191585183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B339191585183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~10-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flowmeters/for-use-with~inert-gas/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19088 pages (at 47 pages/min), scraped 439 items (at 1 items/min)
2026-01-04 05:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-bonding-caulk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flowmeters/for-use-with~inert-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2290T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222290T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fluke-373-multimeters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~2-1-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=453523490803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B453523490803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967870%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~5-8-11-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4218K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224218K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2290T31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222290T31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluke-373-multimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90044A228&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290044A228%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~12-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threadlocker-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fluorescent-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/three-piece-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fluorescent-light-fixtures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19138 pages (at 50 pages/min), scraped 441 items (at 2 items/min)
2026-01-04 05:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/throttle-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threadlocker-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~6-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=belt-frequency-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fmc-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluorescent-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=three-piece-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluorescent-light-fixtures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=throttle-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=belt-tension-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foam-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fmc-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tie-down-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soow-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tie-down-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tie-down-winches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~1-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tie-down-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bench-top-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tie-down-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=berms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tie-down-winches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19187 pages (at 49 pages/min), scraped 441 items (at 0 items/min)
2026-01-04 05:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sink-drain-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drivers/driver-style~fold-up/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~1-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/folding-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/for-housing-id~55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-grade-plastics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001625480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~30-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/screw-size~m130/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fold-up-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bicycle-sprockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001625480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~1-7-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=folding-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000110435%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~55mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-grade-plastics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/overall-length~3-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-screw-size~m130&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/for-housing-id~55mm/
2026-01-04 05:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/screw-size~m28/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/shaft-diameter~1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=siphon-loops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/for-screw-size~m130/
2026-01-04 05:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/shaft-diameter~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=siren-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~3-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19231 pages (at 44 pages/min), scraped 441 items (at 0 items/min)
2026-01-04 05:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~29-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-screw-size~m28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/ties/length~3-1-8/
2026-01-04 05:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-shaft-diameter~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-shaft-diameter~4mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000100012%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-industry-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=skate-wheels/wheel-diameter~4-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612166%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/for-screw-size~m28/
2026-01-04 05:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/for-shaft-diameter~1-8/
2026-01-04 05:40:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/for-shaft-diameter~4mm/
2026-01-04 05:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8350698174345&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=skate%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8350698174345%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001930043%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tile-cutting-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5125N121&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225125N121%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-industry-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000156201%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foot-switch-pedals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/time-counters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/screw-size~m135&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/screw-size~m2-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tile-cutting-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455667%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334803%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/material~bronze/
2026-01-04 05:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blades/precision-knife-blade-type~heavy-scraping/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blacksmiths-anvils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foot-switch-pedals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=time-counters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19282 pages (at 51 pages/min), scraped 442 items (at 1 items/min)
2026-01-04 05:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/forming-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/screw-size~no-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sleeves/performance~high-strength-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-clamping-hangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/screw-size~no-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/blade-type~heavy-scraping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334494%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000027156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/blades/blade-type~heavy-scraping/
2026-01-04 05:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tires/tire-size~4-80-4-00-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=forming-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blasting-glass-beads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeves/performance-properties~high-strength&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tires/tire-size~4-00-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/plastic-clamping-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sleeves/performance-properties~high-strength/
2026-01-04 05:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971113029698&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971113029698%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222379302435520%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tires/tire-size~4-80-4-00-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=split-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blind-transfer-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3166T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223166T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tires/tire-size~4-00-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:41:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tires/tire-size~4-80-4-00-8/
2026-01-04 05:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blower-filter-housings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blowers/power-source~electric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuel-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~tl-2200/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1409080599349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1409080599349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19327 pages (at 45 pages/min), scraped 443 items (at 1 items/min)
2026-01-04 05:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuel-line-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9955125964573&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blowers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9955125964573%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blue-dyed-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuel-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tl-2200-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuel-line-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blueprint-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1409080599349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1409080599349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fume-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bluetooth-levels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sling-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-contacts/for-relay-manufacturer~furnas/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fume-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/furniture-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sling-savers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slings/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-loaded-seals/for-use-with~phosphoric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boatswains-chairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1409080599349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1409080599349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2097997231456&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=slings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2097997231456%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9759667665353&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spring%20loaded%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9759667665353%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=furnas-innova-compatible-electrical-contacts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19376 pages (at 49 pages/min), scraped 443 items (at 0 items/min)
2026-01-04 05:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/current~150-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slip-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=furniture-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tool-boxes/mounting-location~truck-underbed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tool-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1409080599349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1409080599349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002109588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~0-73&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2097997231456&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=slings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2097997231456%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9759667665353&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spring%20loaded%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9759667665353%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~150a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tool-holding-magnets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622392%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fuses/current~150a/
2026-01-04 05:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~14-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-boxes/mounting-location~truck-underbed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~11-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2097997231456&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=slings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2097997231456%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tool-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9759667665353&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spring%20loaded%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9759667665353%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9668381733305&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9668381733305%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-holding-magnets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/manufacturer-equivalent-fuse~trs-r-id/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~14millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/fuse-ul-class~k5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6781A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226781A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2097997231456&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=slings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2097997231456%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9759667665353&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spring%20loaded%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9759667665353%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:44:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~14millimeters/
2026-01-04 05:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19425 pages (at 49 pages/min), scraped 444 items (at 1 items/min)
2026-01-04 05:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/voltage~1000v-dc-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/voltage~160v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/manufacturer-equivalent~trs-r-id&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~g24d-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/military-specification~ms51575-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/ul-class-k5-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~27-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fuses/manufacturer-equivalent~trs-r-id/
2026-01-04 05:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~2-75/length~2-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fuses/ul-class-k5-fuses/
2026-01-04 05:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/voltage~1000v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/voltage~160v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/military-specification~ms51575-11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001607695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626337%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=g24d-3-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=small-batch-mixers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/military-specifications-met~ms51575-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toplock-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~27millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fuses/voltage~1000v-dc/
2026-01-04 05:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553626%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bolts/military-specifications-met~ms51575-20/
2026-01-04 05:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~27millimeters/
2026-01-04 05:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/finish~galvanized/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/specifications-met~ms51575-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~44-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toplock-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bolts/specifications-met~ms51575-11/
2026-01-04 05:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~000-120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=smoke-removal-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanized-steel-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~44millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19473 pages (at 48 pages/min), scraped 444 items (at 0 items/min)
2026-01-04 05:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~79-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=smoke-pencils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=smoke-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~44millimeters/
2026-01-04 05:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-indicators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~1-1-8-to-1-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~3-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~79-5millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torx-screwdriver-bit-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333442%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-gauges/container-type~case&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~79-5millimeters/
2026-01-04 05:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-on-wire-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/keyway-width~14-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/for-shaft-diameter~1-1-8-to-1-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2055261603932&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=snap%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2055261603932%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122531%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/for-shaft-diameter~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torx-screwdriver-bit-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/for-shaft-diameter~1-1-8-to-1-7-8/
2026-01-04 05:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/for-shaft-diameter~2-1-4/
2026-01-04 05:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/for-use-with~chlorine/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boots/protects-against~welding-spatter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-125/id~1-1-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/capacity~12-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/keyway-width~14mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2055261603932&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=snap%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2055261603932%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122531%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snow-throwers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19519 pages (at 46 pages/min), scraped 444 items (at 0 items/min)
2026-01-04 05:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9986634754830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=boots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9986634754830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002344437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/keyway-width~14mm/
2026-01-04 05:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bore-gauges/manufacturer-model-number~269b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~chlorine&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity-weight-~12-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/capacity~330-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~1-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2055261603932&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=snap%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2055261603932%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122531%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=191095061359&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bore%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B191095061359%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9986634754830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=boots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9986634754830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002344437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~1-1-8/
2026-01-04 05:46:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/totes/capacity-weight-~12-gal-/
2026-01-04 05:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~1-to-1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=77495A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2277495A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/capacity~88-fl-oz/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2055261603932&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=snap%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2055261603932%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122531%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003178292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9986634754830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=boots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9986634754830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002344437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bore-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/color~light-blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K92&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K92%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~3-8-to-1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity-weight-~88-fl-oz-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003178258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9986634754830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=boots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9986634754830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002344437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19571 pages (at 52 pages/min), scraped 446 items (at 2 items/min)
2026-01-04 05:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spst-no-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/totes/capacity-weight-~88-fl-oz-/
2026-01-04 05:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000145054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/color~light-blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/material~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K86&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K86%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spt-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/touch-sensitive-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002192795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bostitch-compatible-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/shape~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/material~leather&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/thickness~0-03/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=touch-sensitive-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/thickness~0-05/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity~1-1-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/totes/material~leather/
2026-01-04 05:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-ball-joint-rod-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/thickness~0-065/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7034539236718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bottles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7034539236718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002192193%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/shape~round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-03&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/thickness~1-mm/thickness~1-000-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-05&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-065&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001465028%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19620 pages (at 49 pages/min), scraped 447 items (at 1 items/min)
2026-01-04 05:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-clamp-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001462198%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~1mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~175-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity~7-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gaskets/thickness~1mm/
2026-01-04 05:48:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001462198%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-065&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/transfer-balls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/dial-type~balanced/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7034539236718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bottles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7034539236718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/transformers/voltage~4-5v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~4-7-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~175-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4135T913&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224135T913%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bottles/capacity-weight-~175-ml/
2026-01-04 05:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=transfer-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/dial-type~balanced&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~4-7-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=transformers/voltage~4-5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4135T913&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224135T913%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-wrench-adapters/square-drive-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:49:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bottles/capacity-weight-~4-7-gal-/
2026-01-04 05:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-heavy-jam-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=803742726147&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B803742726147%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19671 pages (at 51 pages/min), scraped 447 items (at 0 items/min)
2026-01-04 05:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/maximum-pressure~12-psi-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/contents-message~solvent-wash-bottle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1687313801023&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20wrench%20adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1687313801023%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-cans/capacity~21-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4135T913&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224135T913%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7034539236718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bottles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7034539236718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084950%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-mesh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/maximum-pressure-psi~1500-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/maximum-pressure~8-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/maximum-pressure-psi~12-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-cans/capacity~95-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=43555T12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2243555T12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=box-rail-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/maximum-pressure-psi~1500-psi/
2026-01-04 05:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity-weight-~21-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4135T913&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224135T913%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001716877%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/trash-cans/capacity-weight-~21-gal-/
2026-01-04 05:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/maximum-pressure-psi~8-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tri-groove-head-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/offset-surface-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity-weight-~95-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measurement-unit~inches-per-hour/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/for-joining~tin&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001703189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measurement-unit~kelvins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-shelving-components&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/trash-cans/capacity-weight-~95-gal-/
2026-01-04 05:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7670440523675&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solder&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7670440523675%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004937884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19715 pages (at 44 pages/min), scraped 448 items (at 1 items/min)
2026-01-04 05:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tri-groove-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/offset-surface-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/scale~in-hr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7670440523675&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solder&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7670440523675%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004937884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/for-joining~tin&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001703189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/scale~kelvin&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223682670437994%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-spring-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-square-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/scale~in-hr/
2026-01-04 05:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/thread-type~unc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/scale~kelvin/
2026-01-04 05:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-connect-fittings-for-brass-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1030A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221030A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001703189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/overhead-conveyor-trolleys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-unthreaded-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-component-knobs/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/thread-type~unc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soldering-coppers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102665%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soldering-iron-tip-tinners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001703189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trolleys/trolleys-for-powered-overhead-beam-conveyors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soldering-irons/ul-file-number~mh19286&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-machine-component-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-rectangular-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/trolleys/trolleys-for-powered-overhead-beam-conveyors/
2026-01-04 05:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19768 pages (at 53 pages/min), scraped 449 items (at 1 items/min)
2026-01-04 05:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5810588826476&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=soldering%20irons&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5810588826476%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005062063%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass/clear-chemical-resistant-pvc-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glides/mount-type~adhesive-back/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~5-16-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoid-valve-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=77125A101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2277125A101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/signs/specifications-met~ghs-standards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9732413836877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9732413836877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223966719972299%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=star-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/shape~tee&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=standoffs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334815%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/voltage~6v-dc-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glides/mount-type~adhesive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002312858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/tube-od~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=77125A101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2277125A101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=globally-harmonized-system-(ghs)-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9732413836877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9732413836877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223966719972299%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/color~beige/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9952801634820&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9952801634820%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/tube-od~3-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4916K2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224916K2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-tube-od~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=77125A101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2277125A101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9732413836877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9732413836877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223966719972299%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/color~beige&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/tube-od~40-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-jackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-tube-od~3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tube-fittings/for-tube-od~2-1-4/
2026-01-04 05:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19817 pages (at 49 pages/min), scraped 449 items (at 0 items/min)
2026-01-04 05:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4916K2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224916K2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002203687%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tube-fittings/for-tube-od~3-1-4/
2026-01-04 05:52:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=77125A101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2277125A101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/color~fluorescent-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/tube-od~38-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9732413836877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9732413836877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223966719972299%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/breakers/current~25-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-tube-od~40mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tube-fittings/for-tube-od~40mm/
2026-01-04 05:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4916K2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224916K2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-(class-150)-pipe-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/adhesive-type~construction/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/color~fluorescent-lime-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-acorn-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-tube-od~38mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solid-stream-spray-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers/manufacturer-series~qp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers/current~25a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gloves/color~fluorescent-lime-green/
2026-01-04 05:52:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tube-fittings/for-tube-od~38mm/
2026-01-04 05:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8180085661429&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=breakers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8180085661429%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:52:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/breakers/current~25a/
2026-01-04 05:52:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4916K2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224916K2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/adhesive-type~construction&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/fitting-type~pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvents/for-use-on~plastic-1/for-use-on~uhmw-polyethylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5259T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225259T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533409%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-hex-pipe-nipples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19864 pages (at 47 pages/min), scraped 449 items (at 0 items/min)
2026-01-04 05:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-alloy-932-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-hex-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sorbothane-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-alloy-954-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7534A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227534A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/type~pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~uhmw-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tube-fittings/type~pipe/
2026-01-04 05:53:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solvents/for-use-on~uhmw-plastic/
2026-01-04 05:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-splitters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-swivel-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sound-absorbing-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~105k/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7534A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227534A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/fabrication~cold-drawn/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sound-level-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-scoops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-splitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-swivel-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~105k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7534A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227534A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/fabrication~cold-drawn&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/for-use-with~calcium-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bs-1363-power-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brushless-motors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002279934%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~3106/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19912 pages (at 48 pages/min), scraped 450 items (at 1 items/min)
2026-01-04 05:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~325/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~105k&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:54:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7534A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227534A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckets/capacity~44-qt/capacity~11-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~calcium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~0-047/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~3106&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091775%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~325&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~499/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buffing-machine-spindles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137733%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops/mount-type~threaded-stud-and-threaded-insert&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7468A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227468A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity-weight-~11-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~0-047&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74545A22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274545A22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962004834368&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962004834368%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/buckets/capacity-weight-~11-gal-/
2026-01-04 05:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buffing-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~499&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7614A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227614A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~50240h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7468A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227468A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~505-uv/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143018%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74545A22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274545A22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~560/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~1-8-2/id~0-125/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~1-65/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 19959 pages (at 47 pages/min), scraped 450 items (at 0 items/min)
2026-01-04 05:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74985A57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274985A57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7614A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227614A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~50240h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7468A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227468A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~505-uv&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146128%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74545A22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274545A22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~560&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~1-65&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~12-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7614A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227614A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7468A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227468A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096530%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tubing/id~1-8/
2026-01-04 05:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74545A22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274545A22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~587/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6937T769&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226937T769%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~12-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7614A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227614A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~76/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2108T77&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222108T77%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/for-use-with~hydrochloric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~9-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~587&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20007 pages (at 48 pages/min), scraped 454 items (at 4 items/min)
2026-01-04 05:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963946302057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bulkheads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963946302057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~76&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-energy-testers/surface-energy~32-dyne-cm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~90ca/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103006%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1282K42&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221282K42%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093407%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~9-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8836857423766&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=surface%20energy%20testers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8836857423766%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002294734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7610A17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227610A17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/enclosure-rating~nema-4x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493279%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5590K102&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225590K102%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~97974/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/material~cork-fiber-reinforced-pvc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/mount-type~hammer-on/mount-type~tack/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~90ca&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000093762%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129229%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switch-designation~dpst/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~dp125/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~dp405/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~97974&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/material~pvc-cork-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/mount-type~hook-and-loop/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/mount-type~hammer-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7610A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227610A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148504%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bumpers/material~pvc-cork-blend/
2026-01-04 05:57:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bumpers/mount-type~hammer-in/
2026-01-04 05:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20052 pages (at 45 pages/min), scraped 458 items (at 4 items/min)
2026-01-04 05:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switch-industry-designation~dpst&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~dp125&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~dp405&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~4-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~2-1-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091718%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131242%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/mount-type~hook-and-loop/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~2-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~m24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7467A65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227467A65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7467A211&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227467A211%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~4a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~2-1-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~rtv106/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~2-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/switching-current~4a/
2026-01-04 05:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/thread-size~2-548-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-voltage~24v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing-carriers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014254%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9118T5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229118T5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001587847%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~rtv106&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushing-bore-hubs/bushing-trade-number~2012&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-spring-snaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/thread-size~m260&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/thread-size~2-548-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20099 pages (at 47 pages/min), scraped 461 items (at 3 items/min)
2026-01-04 05:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123054%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-carriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1242777880953&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushing%20bore%20hubs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1242777880953%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001994206%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014254%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cartridges/manufacturer~gojo/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454427%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/thread-size~2-548-18/
2026-01-04 05:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74975A53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274975A53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~3-137-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~1-2-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014254%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gojo-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~1-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tungsten-with-material-certification/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~3-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slotted-framing-component~conveyor&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~3-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~3-137-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~1-2-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 05:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333442%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136766%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014254%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 05:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:58:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/thread-size~3-137-12/
2026-01-04 05:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten-with-material-certification&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=91732A001&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2291732A001%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T462&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T462%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slotted-framing-component~rail-slide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20151 pages (at 52 pages/min), scraped 462 items (at 1 items/min)
2026-01-04 05:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slotted-framing-component~rail&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spc-data-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slotted-framing-component~start-stop-switch-mount&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spc-wireless-transmitters/manufacturer-model-number~02azd730g-e&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110862%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-rails/color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-a516-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-ar400-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4028N25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224028N25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slots&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134180%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968632181869&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spc%20wireless%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968632181869%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m155&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3136N522&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223136N522%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451540%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47065T504&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247065T504%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-a516-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-ar400-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m260&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-g-10-garolite-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-resistant-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454427%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 05:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=speed-limit-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turnbuckles/thread-size~4-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turntables/turntable-style~open/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-h13-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=business-card-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-g-10-garolite-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20200 pages (at 49 pages/min), scraped 467 items (at 5 items/min)
2026-01-04 06:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/material~rubber-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/graphene-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turnbuckles/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/graphite-and-fiber-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turntables/turntable-style~open&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-h13-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~21-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~9-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~50-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1450694992374&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1450694992374%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150196%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=graphene-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=graphite-and-fiber-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/string/construction~twisted/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zerk-fittings/grease-fitting-style~button-head/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=63195K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2263195K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~9-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~50-ft&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/two-part-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:00:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tape-measures/length~9-ft-/
2026-01-04 06:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~bspt/pipe-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twisted-string&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx34/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=button-head-zerks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spiral-duct-dampers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20248 pages (at 48 pages/min), scraped 468 items (at 1 items/min)
2026-01-04 06:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-part-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074440%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-nuts/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~28-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~delvac-extreme/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx34-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~krytox-gpl-106/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx96/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tee%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~krytox-xht-bdx/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape-number~c7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~28mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bypass-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~delvac-extreme&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx96-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~krytox-xht-bdx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~28mm/
2026-01-04 06:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089067%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-style-retaining-ring-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-shape-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermometers/measurement-unit~celsius/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=split-head-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/u-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~c62/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2276K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222276K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20293 pages (at 45 pages/min), scraped 468 items (at 0 items/min)
2026-01-04 06:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~c95/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/splitters/signal-type~data/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermometers/scale~celsius&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=split-rubber-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c62-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2276K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222276K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/thermometers/scale~celsius/
2026-01-04 06:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c95-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/uhmw-polyethylene-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=splitters/connection-type~ethernet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~never-seez-regular-grade/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2276K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222276K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/splitters/connection-type~ethernet/
2026-01-04 06:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinets/cabinet-type~pass-through&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sponges/material~stainless-steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~velocite-no-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spool-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~velocite-no-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=uhmw-polyethylene-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~never-seez-regular-grade&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4204073794379&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cabinets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4204073794379%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134826%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997050834426&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sponges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997050834426%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~wd-40-industrial/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2276K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222276K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136502%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4310N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224310N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20341 pages (at 48 pages/min), scraped 469 items (at 1 items/min)
2026-01-04 06:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~velocite-no-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~velocite-no-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997050834426&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sponges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997050834426%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~wd-40-industrial&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129211%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=three-way-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tie-down-anchors/base-material~plastic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spotnails-compatible-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997050834426&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sponges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997050834426%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1347K37&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221347K37%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4329228565151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tie%20down%20anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4329228565151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000141339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~18-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:03:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997050834426&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sponges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997050834426%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-bottles/capacity~15-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~20-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-bottles/capacity-weight-~1-1-2-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561033%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~24-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-nozzles/certification~ul-listed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20393 pages (at 52 pages/min), scraped 473 items (at 4 items/min)
2026-01-04 06:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=220833974646&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20bottles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B220833974646%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140146%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562589%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spray-bottles/capacity-weight-~1-1-2-gal-/
2026-01-04 06:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toggle-clamp-plungers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7394K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227394K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562306%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-nozzles/food-industry-standard~fda-compliant-21-cfr-177-2415&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6778563655339&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6778563655339%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002091847%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinders/manufacturer-model-number~7760-n-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8219K59&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228219K59%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5106N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225106N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6778563655339&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6778563655339%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111206%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~32-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinders/power-source~battery/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3180K3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223180K3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-nozzles/food-industry-standard~fda-compliant-21-cfr-211-65&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/manufacturer-model-number~7760-n-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562530%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-steel-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5106N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225106N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-nozzles/spray-application~high-volume&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6778563655339&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6778563655339%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115028%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-limiters/shaft-diameter~15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135348%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3890N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223890N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/power-source~battery&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6778563655339&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6778563655339%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:05 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135348%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/manufacturer-model-number~7760-n-10&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7064T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227064T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076444%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5106N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225106N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20441 pages (at 48 pages/min), scraped 477 items (at 4 items/min)
2026-01-04 06:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3282K421&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223282K421%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~dark-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4201406204775&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=torque%20limiters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4201406204775%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002242778%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002203177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~ford-gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~gpt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~fluorescent-yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5106N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225106N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=traceable-tape-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/certification~gs-marked&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002198637%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~81-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/for-use-on~carbide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4782N126&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224782N126%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/industry-designation~gpt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/industry-designation~gpt/
2026-01-04 06:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~school-bus-yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-on~carbide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/material~jute&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/usb-ports/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity~22-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/for-use-with~handheld-power-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002205201%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512612%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8168905638803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trash%20cans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8168905638803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116161%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20490 pages (at 49 pages/min), scraped 480 items (at 3 items/min)
2026-01-04 06:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=usb-ports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1936T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221936T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-with~hand-held-power-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/for-use-with~surface-grinder-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/utility-knives/blade-type~retracting-breakaway/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/grinding-wheels/for-use-with~hand-held-power-drills/
2026-01-04 06:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-cans/capacity~18-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/voltage~7-5v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity~7-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grip-lock-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-with~surface-grinder-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8168905638803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trash%20cans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8168905638803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967304%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grip-serts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity-weight-~18-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~7-5v-dc-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grip-lock-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967304%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-with~surface-grinder-wheels&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grippers/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/trash-cans/capacity-weight-~18-gal-/
2026-01-04 06:06:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/voltage~7-5v-dc-1/
2026-01-04 06:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/track-rollers/environment~dusty/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/outer-circumference~132/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/outer-circumference~35-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grip-serts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trolley-hoists&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grippers/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trolleys/dust-resistant-roller-track-for-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=608445669459&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B608445669459%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~132inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20535 pages (at 45 pages/min), scraped 481 items (at 1 items/min)
2026-01-04 06:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~35-5inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3994983870935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trolleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3994983870935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%224696737513382%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-coils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/v-belts/outer-circumference~132inches/
2026-01-04 06:07:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/v-belts/outer-circumference~35-5inches/
2026-01-04 06:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-loaded-grab-catches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1054A105&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221054A105%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/hole-diameter~5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/tube-od~32-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~v371/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/hole-diameter~5-8/hole-diameter~0-625/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/for-use-with~oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/for-hole-diameter~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-tube-od~32mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v371-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-pin-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/grommets/for-hole-diameter~5-16/
2026-01-04 06:07:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tube-fittings/for-tube-od~32mm/
2026-01-04 06:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/for-hole-diameter~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/for-use-with~oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-tie-mounts/mount-type~adhesive-back/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/shape~oval/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:07:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/grommets/for-hole-diameter~5-8/
2026-01-04 06:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tie-mounts/material~pei&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/groove-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654142549447&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20tie%20mounts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654142549447%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tie-mounts/mount-type~adhesive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20576 pages (at 41 pages/min), scraped 482 items (at 1 items/min)
2026-01-04 06:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/shape~oval&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=groove-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/guards/material~cork/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654142549447&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20tie%20mounts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654142549447%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~14-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~1-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654142549447&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20tie%20mounts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654142549447%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/shape~oval&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guards/material~cork&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/guards/material~metal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/guides/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980676003823&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980676003823%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~14-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guards/material~metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guides/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654142549447&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20tie%20mounts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654142549447%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable-ties/length~14-ft-/
2026-01-04 06:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980676003823&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980676003823%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510711%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/guides/material~fiberglass/
2026-01-04 06:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~300-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~0-31&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654142549447&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20tie%20mounts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654142549447%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~96-000mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/guy-line/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980676003823&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980676003823%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guards/material~cork&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001598782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~96-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~1-05-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~0-530&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20627 pages (at 51 pages/min), scraped 482 items (at 0 items/min)
2026-01-04 06:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:13 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~4-1-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valve-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630156%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guy-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~96-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammer-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~1-05&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~96-000mm/
2026-01-04 06:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~1-42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/id~1-05/
2026-01-04 06:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammer-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614171%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammers/head-weight~12-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/military-specifications-met~ms3367-19&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~11-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~16-000-mm/id~16-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:09:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable-ties/military-specifications-met~ms3367-19/
2026-01-04 06:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammers/head-weight~48-oz/head-weight~3-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494212%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~13-625&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~12-lbs-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20674 pages (at 47 pages/min), scraped 482 items (at 0 items/min)
2026-01-04 06:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~2-500/id~2-5/id~2-1-2-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001613007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tray-hanging-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tray-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hammers/head-weight~12-lbs-/
2026-01-04 06:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cad-drawing-storage-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502555%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~3-lbs-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hand-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/handle-style~pull/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hammers/head-weight~3-lbs-/
2026-01-04 06:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~4-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~5-8-1/id~0-625/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hand-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/thread-type~bspp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/handle-style~pull&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~7-625&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bin-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~9-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50415K64&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250415K64%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968799%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/thread-type~bspp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/id~5-8/
2026-01-04 06:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4723K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224723K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000037076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20722 pages (at 48 pages/min), scraped 483 items (at 1 items/min)
2026-01-04 06:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/valve-function~back-pressure-regulation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4802N41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224802N41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handles/thread-size~1-1-4-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/material~316-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~0-009&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/distance-measured~0-to-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510513%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/valve-function~back-pressure-regulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083777%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/thread-size~1-1-4-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~1-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003216219%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~1-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~27-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002067699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~274-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8988K83&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228988K83%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000059648%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handles/thread-size~6-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000120070%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4662K46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224662K46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112144%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=92428A670&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2292428A670%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7609K5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227609K5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~275-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hangers/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/thread-size~6-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20772 pages (at 50 pages/min), scraped 488 items (at 5 items/min)
2026-01-04 06:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4662K46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224662K46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~799az-40-1000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bit-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103832%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/system-of-measurement~metric/material~copper-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calipers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005330342%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hangers/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-latches/key-number~92304&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4662K46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224662K46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hangers/material~plastic/
2026-01-04 06:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2104451082401&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cam%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2104451082401%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401120%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hard-fiber-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hardware-trays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-latches/key-number~c205a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-latches/key-number~c346a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1226A46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221226A46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-hole-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4662K46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224662K46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/harsh-environment-push-button-pilot-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2104451082401&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cam%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2104451082401%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2104451082401&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cam%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2104451082401%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400880%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cam-levers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cams/fitting-connection~butt-weld/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hard-fiber-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hardware-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1770A911&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221770A911%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hazardous-location-blowers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1770A527&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221770A527%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20821 pages (at 49 pages/min), scraped 489 items (at 1 items/min)
2026-01-04 06:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=harsh-environment-push-button-pilot-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cams/connection-style~butt-weld&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hdpe-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/candle-wicks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-location-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cams/connection-style~butt-weld/
2026-01-04 06:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=canoe-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=unistrut-pipe-straps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~9-813&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-set-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~9-813/
2026-01-04 06:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hdpe-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=candle-wicks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~9inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-set-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indicators/measures~heat-stress-index/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~9inches/
2026-01-04 06:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blank-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/video-transmission-equipment/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/pipe-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20867 pages (at 46 pages/min), scraped 491 items (at 2 items/min)
2026-01-04 06:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-stress-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blind-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbide-tipped-band-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=video-transmission-equipment&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/type~applicator&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vinyl-mats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/thread-size~7-8-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vinyl-pipe-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vise-grips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sensors/detects~carbon-monoxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~7-8-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel-rod-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vise-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-tow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-monoxide-(co)-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7051711979057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7051711979057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333387%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carpenters-hatchets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20916 pages (at 49 pages/min), scraped 491 items (at 0 items/min)
2026-01-04 06:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-key-wrench-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washer-head-thread-cutting-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~11-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carpenters-hatchets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-rivet-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carpenters%27-hatchets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504958%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-key-wrench-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-socket-panel-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~11-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/voltage-marking-decals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~75-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-rivet-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-low-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-pressure-sodium-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/for-screw-size~11-32/
2026-01-04 06:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507787%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-pressure-thread-lock-hose-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-socket-panel-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=case-hardened-splines&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=voltage-marking-decals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2344K94&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222344K94%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-low-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-pressure-sodium-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caster-mounting-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-pressure-thread-lock-hose-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 20965 pages (at 49 pages/min), scraped 492 items (at 1 items/min)
2026-01-04 06:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floor-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/screw-size~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chairs/mounting-location~wall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-temperature-strip-doors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453979%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolt-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/floor-locks-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/screw-size~m5-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-mount-chairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/wheel-diameter~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolt-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolt-shims&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/casters/floor-locks-4/
2026-01-04 06:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-temperature-strip-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolt-isolation-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinge-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=casters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001930213%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/screw-size~m5-5&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinged-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-joint-rod-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=22925T831&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2222925T831%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/shape~made-to-order&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinge-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~65&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002312831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21014 pages (at 49 pages/min), scraped 493 items (at 1 items/min)
2026-01-04 06:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cat-v40-end-mill-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~70&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinged-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/ball-joint-rod-ends-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523535%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%221820468762609%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=category-3-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/warehouse-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=category-3-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=60645K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2260645K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/relays/environment~washdown/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wax-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caulk-guns/cartridge-size~6-7-fl-oz&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-nuts/thread-size~3-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washer-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=warehouse-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~19-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5900938452762&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caulk%20guns&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5900938452762%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004893076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=60645K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2260645K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cb-radio-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5106733238115&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=weld%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5106733238115%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washdown-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washer-grommets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7636T15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227636T15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washer-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21065 pages (at 51 pages/min), scraped 493 items (at 0 items/min)
2026-01-04 06:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=60645K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2260645K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/mounting-location~ceiling/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/roller-chain-trade-number~08b-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceiling-fan-speed-controls/ul-file-number~e31373&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washer-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~3-3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/for-joining~acrylic-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4338917192034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ceiling%20fan%20speed%20controls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4338917192034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005167776%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-torches/manufacturer-model-number~ca1350&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=60645K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2260645K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004792315%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceiling-mount-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/axle-diameter~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-trade-size~08b-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/finish~powder-coated-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~3-3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/mount-type~adhesive-back/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7140856590719&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7140856590719%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/roller-chain-trade-size~08b-2/
2026-01-04 06:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000080165%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:56 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7140856590719&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20torches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7140856590719%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-torches/manufacturer-model-number~ca1350&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-padlockable-hasps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/range-of-motion~220/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~1-1-8-7-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/finish~powder-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/mount-type~machinable-hub&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2440K47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222440K47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/mount-type~adhesive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lid-supports/opening-closing-action~soft-open/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21107 pages (at 42 pages/min), scraped 494 items (at 1 items/min)
2026-01-04 06:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/finish~powder-coated/
2026-01-04 06:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010540%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/plastic-padlockable-hasps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/range-of-motion~220-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=center-gauges/manufacturer~starrett-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-1-8-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010540%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/mount-type~machinable-hub&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hinges/plastic-padlockable-hasps/
2026-01-04 06:19:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hinges/range-of-motion~220-/
2026-01-04 06:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6760751784651&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=center%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6760751784651%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002267107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/soft-opening-lid-supports-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bolts/thread-size~1-1-8-7/
2026-01-04 06:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m55/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/american-wire-gauge-awg~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hoist-controls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m56/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m75/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~15-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hinges/soft-opening-lid-supports-5/
2026-01-04 06:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hoist-rings/thread-size~1-1-4-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m76/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562241%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-awg~24-3-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m55&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-controls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m75&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-rings/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~m55/
2026-01-04 06:20:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~m56/
2026-01-04 06:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hoist-rings/thread-size~5-16-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~m75/
2026-01-04 06:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m76&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21151 pages (at 44 pages/min), scraped 495 items (at 1 items/min)
2026-01-04 06:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6716761090215&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6716761090215%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~24-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~no-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/shape~ring/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~m76/
2026-01-04 06:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/cable-awg~24-3/
2026-01-04 06:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-filled-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-414/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-rings/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~no-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/shape~ring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=holders/mount-type~pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6716761090215&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6716761090215%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-023-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-330-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~no-3/
2026-01-04 06:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-519/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/holders/mount-type~pipe/
2026-01-04 06:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-414&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:20:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/specifications-met~ms15795-414/
2026-01-04 06:21:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8097T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228097T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/material~titanium-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-d0416h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-d0432h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-519&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-510-welding-gas-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-d1490h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spz900-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21195 pages (at 44 pages/min), scraped 495 items (at 0 items/min)
2026-01-04 06:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~40-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/specifications-met~ms15795-519/
2026-01-04 06:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/material~titanium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0416h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/leaf-chain-trade-number~bl634/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0432h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~c2060h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~25mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d1490h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/material~titanium/
2026-01-04 06:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~40-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074515%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hole-punches/for-hole-diameter~25mm/
2026-01-04 06:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/sash-chain-trade-size~45/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-pegboards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/roller-chain-trade-size~40-6/
2026-01-04 06:21:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074515%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0416h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~bl634&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:45 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0432h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/6-chain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~c2060h-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d1490h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/u-s-state-territory~washington/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/roller-chain-trade-size~bl634/
2026-01-04 06:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:21:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/roller-chain-trade-size~c2060h-ss/
2026-01-04 06:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/trade-size~45&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-alignment-lasers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-barrier-magnet-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/honeywell-respirator-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/trade-size~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/trade-size~45/
2026-01-04 06:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washington-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-boomers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21243 pages (at 48 pages/min), scraped 495 items (at 0 items/min)
2026-01-04 06:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-breakers/roller-chain-trade-number~100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/trade-size~6/
2026-01-04 06:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4740521818155&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20breakers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4740521818155%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000036660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=honeywell-respirator-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squares/material~plastic-1/material~acetal/material~delrin-acetal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hooks/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squares/shape~half-round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-lanyards/chain-style~sash&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-link-fencing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-number~140h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958961006685&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=squares&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958961006685%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boston-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~sr920sw/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958961006685&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=squares&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958961006685%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7741739173953&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20lanyards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7741739173953%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394279%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-resistant-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2977408974097&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2977408974097%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102194%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hooks/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~100-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/for-use-with~sodium-hypochlorite-bleach/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hooks/material~fiberglass/
2026-01-04 06:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~60-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wave-disc-spring-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/for-use-with~citric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sr920sw-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-resistant-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wax-paper-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21286 pages (at 43 pages/min), scraped 495 items (at 0 items/min)
2026-01-04 06:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~100-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~bleach&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~60-2ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-saws/power-source~electric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wave-disc-spring-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~citric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain-links/roller-chain-trade-size~100-2/
2026-01-04 06:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wax-paper-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/for-use-with~bleach/
2026-01-04 06:23:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain-links/roller-chain-trade-size~60-2ss/
2026-01-04 06:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9458172807290&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9458172807290%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-bent-anchor-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-021/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-bolting-drawer-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-052/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screw-mount-weatherstripping/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-wear-gauges/roller-chain-trade-number~60&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/weatherstripping-tape-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-106/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-162/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-021inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-052inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4084108751959&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20wear%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4084108751959%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000095338%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weatherstripping/mount-type~screw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chamfer-router-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-connector-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-021inches/
2026-01-04 06:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-052inches/
2026-01-04 06:24:10 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4084108751959&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20wear%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4084108751959%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000095338%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-wear-gauges/roller-chain-trade-number~60&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-106inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21335 pages (at 49 pages/min), scraped 495 items (at 0 items/min)
2026-01-04 06:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985754296413&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985754296413%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011043%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-210/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-162inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/weights/approximate-weight~5-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weatherstripping-tape-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-106inches/
2026-01-04 06:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/weld-on-eyebolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-162inches/
2026-01-04 06:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-21inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~phosphoric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weights/approximate-weight~5-lbs-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-on-eyebolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-21inches/
2026-01-04 06:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/thread-type~ght&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=check%20valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/weights/approximate-weight~5-lbs-/
2026-01-04 06:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=box-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemical-resistant-aprons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=check%20valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cheesecloth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=check%20valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079141%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-96/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7909K91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227909K91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4721K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224721K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chevron-flange-mounted-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-96inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21387 pages (at 52 pages/min), scraped 497 items (at 2 items/min)
2026-01-04 06:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~2-43/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=china-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-push-to-connect-tube-to-pipe-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/framing-type~t-slotted&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chisels-of-masonry&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-96inches/
2026-01-04 06:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chlorine-test-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~2-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=choose-a-color-pvc-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~20-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~2-43inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~22-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~2-43inches/
2026-01-04 06:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~2-9inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chromel-c-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~20-4375inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3j-collets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~5-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~22millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~2-9inches/
2026-01-04 06:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:25:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~20-4375inches/
2026-01-04 06:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~22millimeters/
2026-01-04 06:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/material~nickel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/thread-type~npt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~5-25inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21432 pages (at 45 pages/min), scraped 497 items (at 0 items/min)
2026-01-04 06:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chucks/3j-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~fuel-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=braided-oil-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cigarette-butt-disposal-containers/material~plastic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~5-25inches/
2026-01-04 06:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~6millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6740743282145&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chucks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6740743282145%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%229418896655480%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=braking-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/thread-type~npt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8380634861939&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cigarette%20butt%20disposal%20containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8380634861939%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/material~nickel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~6millimeters/
2026-01-04 06:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3811A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223811A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~fuel-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stair-edging&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/material~nickel/
2026-01-04 06:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/wheel-diameter~140-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamp-on-framing-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/wheel-diameter~2-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~xenon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3811A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223811A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/shape~45-elbow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamp-on-multimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~140-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps/clamping-action~pull-only&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~2-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21479 pages (at 47 pages/min), scraped 497 items (at 0 items/min)
2026-01-04 06:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001933346%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~xenon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3811A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223811A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/shape~45-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=class-10-steel-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/grinding-wheel-designation~type-29/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9791062983264&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clamps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9791062983264%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929224%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965347%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002312722%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5138A32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225138A32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-reels/mounting-location~ceiling/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8946T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228946T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3811A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223811A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/grinding-wheel-designation~type-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-type~type-29&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/humidity-indicators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wheels/wheel-type~type-29/
2026-01-04 06:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-reels/mounting-location~ceiling&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8946T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228946T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clean-room-absorbents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clean-room-benches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clean-room-marking-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-disconnect-barbed-tube-fittings/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-type~type-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5645990825690&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5645990825690%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002245268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-pipe-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=humidity-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wheels/wheel-type~type-7/
2026-01-04 06:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8946T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228946T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21530 pages (at 51 pages/min), scraped 498 items (at 1 items/min)
2026-01-04 06:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-quick-disconnect-barbed-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-awg~18-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-awg~18-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-awg~24-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/impact-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~1-3-8-6-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-tube-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/fitting-type~link-ring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8946T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228946T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=standoffs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/impact-torx-bit-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~18-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001919443%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clips/material~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~24-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=impact-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=standoffs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~1-3-8-6-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~18-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-awg~8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clock-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inconel-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=impact-torx-bit-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/material~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8219K53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228219K53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indelible-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/clips/material~wood/
2026-01-04 06:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21574 pages (at 44 pages/min), scraped 499 items (at 1 items/min)
2026-01-04 06:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inconel-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561937%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clothing/material~gore-tex-pyrad-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cloth/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indelible-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cloth/material~copper-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=starrett-depth-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indicators/for-use-with~hydrogen/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968537056579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cloth&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968537056579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968537056579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cloth&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968537056579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clothing/material~gore-tex-nylon-fabric-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indicators/for-use-with~refrigerant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9224T45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229224T45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inline-gear-boxes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:29:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/clothing/material~gore-tex-nylon-fabric-blend/
2026-01-04 06:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inline-water-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~hydrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968537056579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cloth&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968537056579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:29:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~co114p3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/drive-style~external-square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967523%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~refrigerant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inline-gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inline-water-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21620 pages (at 46 pages/min), scraped 501 items (at 2 items/min)
2026-01-04 06:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968537056579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cloth&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968537056579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~composite-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=co114p3-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~0-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/drive-style~external-square&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949688381693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=coatings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949688381693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003433251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968537056579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cloth&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968537056579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~1-7-8-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/inserts/material~plastic/
2026-01-04 06:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~3-15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=code-61-flange-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-uhmw-polyethylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~3-8-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545168%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~1-7-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stationary-spray-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coil-spring-compressors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-15mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:01 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545168%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-24&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/inserts/thread-size~1-7-8-12/
2026-01-04 06:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~3-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/diameter~3-15mm/
2026-01-04 06:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~8-36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21667 pages (at 47 pages/min), scraped 501 items (at 0 items/min)
2026-01-04 06:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steam-lances&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~cmg/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~multimode-om1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~4mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~ofnr/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~sjeow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/diameter~4mm/
2026-01-04 06:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~8-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~cmg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~multimode-om1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~ofnr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~sjeow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collapsible-shovels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/industry-designation~cmg/
2026-01-04 06:31:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/industry-designation~multimode-om1/
2026-01-04 06:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inset-door-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/industry-designation~ofnr/
2026-01-04 06:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-(schedule-xxh)-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/industry-designation~sjeow/
2026-01-04 06:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/outer-jacket-material~nylon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/american-wire-gauge-awg~17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/american-wire-gauge-awg~18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collet-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inset-door-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/american-wire-gauge-awg~23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~1-3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21713 pages (at 46 pages/min), scraped 501 items (at 0 items/min)
2026-01-04 06:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/outer-insulation-material~polyamide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/wire-gauge~17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~55-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~1-1-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/wire-gauge~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/wire-gauge~23&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3223A404&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223223A404%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/outer-insulation-material~polyamide/
2026-01-04 06:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-brushes/shank-style~threaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/wire-gauge~17/
2026-01-04 06:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/wire-gauge~18/
2026-01-04 06:32:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/wire-gauge~23/
2026-01-04 06:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-hangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-clippers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3223A467&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223223A467%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~8mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~43-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~1-1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-brushes/shank-style~threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/collet-size~8mm/
2026-01-04 06:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~1-1-64/
2026-01-04 06:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=browse-pipe-tubing%2C-hose-and-fittings/routing-and-suspending&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5718544194190&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5718544194190%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001999143%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~47-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation-heat-barriers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-clippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~43-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/browse-pipe-tubing%2C-hose-and-fittings/routing-and-suspending/
2026-01-04 06:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~3-32/
2026-01-04 06:33:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~4-mm/
2026-01-04 06:33:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/collets/size~43-64/
2026-01-04 06:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21757 pages (at 44 pages/min), scraped 503 items (at 2 items/min)
2026-01-04 06:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-crimpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-heat-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inverted-flares/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation-heat-shields/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-management-grommets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-garbage-and-recycling-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-sponges-and-squeegees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-crimpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-mesh/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-square-blades/length~24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inverted-flares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6619637192909&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20square%20blades&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6619637192909%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001629723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-management-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roller-chain/chain-standard~iso/roller-chain-trade-number~12b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-rope-crimp-fitting-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-rope-crimpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~23-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~3-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-mesh/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jackets/material~polyester-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire-mesh/material~brass/
2026-01-04 06:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~m2-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-12b-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-crimp-fitting-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-crimpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~23-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~3-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21799 pages (at 42 pages/min), scraped 503 items (at 0 items/min)
2026-01-04 06:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~1-72/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~23-mm/
2026-01-04 06:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/material~polyester-rubber-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~3-2-mm/
2026-01-04 06:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m2-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkhead-drain-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~m62/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/jackets/material~polyester-rubber-blend/
2026-01-04 06:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~m8-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-72&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compound-miter-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkhead-unions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-aftercoolers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m2-5&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-saw-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m62&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~m8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-screws/length~1-13-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/jam-nuts/thread-size~m8/
2026-01-04 06:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/for-use-with~mineral-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=step-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-tube-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jaw-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963946302057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bulkheads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963946302057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21847 pages (at 48 pages/min), scraped 503 items (at 0 items/min)
2026-01-04 06:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/length~1-13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jigs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-wall-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001629691%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motors/enclosure-rating~ip65&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jaw-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motors/motor-frame-size~nema-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concrete-curing-vibrators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5513810907834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stepper%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5513810907834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concrete-mixing-hoes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/work-lights/mount-type~eyebolt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jigs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5513810907834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stepper%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5513810907834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001573764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/junction-boxes/environment~outdoor/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5513810907834&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stepper%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5513810907834%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stepper-motors/enclosure-rating~ip65&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/work-positioning-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=condensate-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/k-lock-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keyed-alike-padlock-keys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-lights/mount-type~eyebolt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keyhole-standoffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=junction-boxes/environment~outdoor&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conductive-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~1-4-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21895 pages (at 48 pages/min), scraped 503 items (at 0 items/min)
2026-01-04 06:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1685134723634&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1685134723634%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-positioning-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~0005/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=k-lock-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5861588236444&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5861588236444%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyed-alike-padlock-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=14965K86&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2214965K86%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyhole-standoffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrap-insulation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0005&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stools/base-material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1041c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1145a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-support-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~hydrogen-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~vegetable-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrap-insulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stools/base-material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1041c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1145a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965162%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/nema-type~l7-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/stools/base-material~iron/
2026-01-04 06:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~1041c/
2026-01-04 06:37:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~1145a/
2026-01-04 06:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops/mounting-location~hinge&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21943 pages (at 48 pages/min), scraped 504 items (at 1 items/min)
2026-01-04 06:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/specifications-met~ansi-lc-4-csa-6-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~3900/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962004834368&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962004834368%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002252641%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/nema-style~l7-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=storage-clipboards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=storage-trunks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/connectors/nema-style~l7-30/
2026-01-04 06:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strain-relief-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/specifications-met~ansi-lc4-csa-6-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3900&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~t6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9552T94&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229552T94%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~15-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/connectors/specifications-met~ansi-lc4-csa-6-32/
2026-01-04 06:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/strap-and-chain-wrenches/strap-material~nylon-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401265%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/writing-utensils/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~a1145ef/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/fitting-connection~quick-clamp-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~t6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~250-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wyes/pipe-size~1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/strap-and-chain-wrenches/strap-material~nylon-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~a1176st/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=writing-utensils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~t6/
2026-01-04 06:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wyes/pipe-size~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 21989 pages (at 46 pages/min), scraped 506 items (at 2 items/min)
2026-01-04 06:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a1145ef&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~a1145ef/
2026-01-04 06:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wyes/pipe-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/x-ring-cord-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a1176st&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~4000-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~by2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wyes/pipe-size~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984228142725&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984228142725%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115817%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~a1176st/
2026-01-04 06:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984228142725&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984228142725%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050647%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~0-781-32-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 500 Internal Server Error
2026-01-04 06:38:45 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <500 https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002212077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true>: HTTP status code is not handled or not allowed
2026-01-04 06:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=x-ring-cord-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~by2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4880K647&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224880K647%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~fr2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449173%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zinc-plated-iron-pipe-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~11-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400353%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-tie-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=street-brooms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~ru46/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22034 pages (at 45 pages/min), scraped 507 items (at 1 items/min)
2026-01-04 06:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~fr2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-plated-iron-pipe-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~11-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~1-1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~10-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stress-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~fr2/
2026-01-04 06:39:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~11-gal-/
2026-01-04 06:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-tie-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~13-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~sm201/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~sh6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~sm737/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~ru46&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~1-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~10-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~16-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~ru46/
2026-01-04 06:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627570%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001631686%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~13-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~70-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sm201&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sm737&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:39:57 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627570%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~1-1-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400357%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~9-5-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401475%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~70-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22078 pages (at 44 pages/min), scraped 507 items (at 0 items/min)
2026-01-04 06:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001601258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-drive-sprockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=controller-extension-cords-for-crx-collaborative-robot-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=structural-joint-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~70-ml/
2026-01-04 06:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~40-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~9-5-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~1-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~9-5-ml/
2026-01-04 06:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knives/blade-type~retracting-breakaway/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knives/blade-type~self-retracting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knives/for-use-on~fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~40-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/grip-style~recessed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strut-channel-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/width~40-mm/
2026-01-04 06:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104361%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/blade-type~retracting-breakaway&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/blade-type~self-retracting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/for-use-on~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/handle-style~offset/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/material~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/grip-style~recessed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035522%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929750%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/mount-type~unthreaded-plug/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=39555A68&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2239555A68%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22122 pages (at 44 pages/min), scraped 507 items (at 0 items/min)
2026-01-04 06:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4923A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224923A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-roller-covers/color~blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/handle-style~offset&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/material~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035522%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6065334404961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20roller%20covers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6065334404961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969222%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/knobs/material~wood/
2026-01-04 06:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/mount-type~expanding-plug&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4923A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224923A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=struts/strut-channel-framing-component~shelf-bracket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/between-frame-width~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/knobs/mount-type~expanding-plug/
2026-01-04 06:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-stops/gauge~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2427054843101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=struts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2427054843101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081438%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/l-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035522%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002261672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stubby-l-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4923A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224923A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T419&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T419%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/l44643-roller-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-stops/gauge~10-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035522%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:42:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4923A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224923A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22175 pages (at 53 pages/min), scraped 509 items (at 2 items/min)
2026-01-04 06:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/conveyor-stops/gauge~10-ga/
2026-01-04 06:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ladder-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ladder-carts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=studs/material~c276-nickel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l44643-roller-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sulfuric-acid-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8073968407539&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=studs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8073968407539%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-door-hardware&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sunroc-water-cooler-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-alloy-102-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lamp-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8073968407539&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=studs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8073968407539%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=studs/material~c276-nickel&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/large-cell-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/large-diameter-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lathes/cut-type~face-grooving/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lamp-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=superior-pneumatic-compatible-air-hammer-chisels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=support-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=large-cell-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copy-stamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=supports/mount-type~crimp-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=supports/mount-type~magnetic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=large-diameter-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22222 pages (at 47 pages/min), scraped 509 items (at 0 items/min)
2026-01-04 06:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992627010166&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=supports&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992627010166%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathes/cut-type~face-grooving&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992627010166&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=supports&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992627010166%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~125-011/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~1255/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~142-002bc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2919599794209&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2919599794209%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002263929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992627010166&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=supports&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992627010166%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=supports/mount-type~crimp-on&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-preparation-cleaners/specifications-met~astm-e1417&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8291N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228291N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/electrical-connection~turn-lock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992627010166&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=supports&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992627010166%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~125-011&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~1255&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~142-002bc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5869950654660&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=surface%20preparation%20cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5869950654660%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002076754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=survival-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/communication-standard~devicenet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143342%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106197%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:43:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/communication-standard~devicenet/
2026-01-04 06:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~8186-1-0-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/connection-type~turn-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992627010166&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=supports&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992627010166%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:03 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106197%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~1255&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~10-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~b-2492-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/connection-type~turn-lock/
2026-01-04 06:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22268 pages (at 46 pages/min), scraped 510 items (at 1 items/min)
2026-01-04 06:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-c34-cp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swinging-latches/mounting-location~surface&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-eur-ews-rk/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~8186-1-0&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992627010166&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=supports&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992627010166%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~250v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~4-5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~10-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~b-2492&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7693864889603&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swinging%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7693864889603%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002236973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~8186-1-0/
2026-01-04 06:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552938%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/nema-style~10-30/
2026-01-04 06:44:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~b-2492/
2026-01-04 06:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-c34-cp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eur-ews-rk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6897K431&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226897K431%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrosion-inhibiting-wraps/military-specification~mil-prf-3420-class-2-style-a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002147598%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corner-shipping-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:44:57 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002147598%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eur-ews-rk&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:44:57 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-c34-cp&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101791%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-resistant-rollers/shoulder-adjustability~adjustable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/lavatory-equipment/manufacturer-model-number~ress-c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-inhibiting-wraps/military-specifications-met~mil-prf-3420-class-2-style-a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/enclosure-rating~nema-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/enclosure-rating~nema-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrugated-bin-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101791%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1057451984853&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=corrosion%20resistant%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1057451984853%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069141%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~ress-c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/automation-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/corrosion-inhibiting-wraps/military-specifications-met~mil-prf-3420-class-2-style-a/
2026-01-04 06:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22313 pages (at 45 pages/min), scraped 511 items (at 1 items/min)
2026-01-04 06:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3608N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223608N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrugated-sheets/color~white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/environmental-rating~nema-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ldpe-rod-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/environmental-rating~nema-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switch-designation~3pst-1no-2nc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~ress-c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/use-for~continuous-motion&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8518130713417&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=corrugated%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8518130713417%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/environmental-rating~nema-3/
2026-01-04 06:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/environmental-rating~nema-7/
2026-01-04 06:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111934%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003138032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-rounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ldpe-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/industry-designation~3pst-1no-2nc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/for-panel-cutout-diameter~4-mm/
2026-01-04 06:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8518130713417&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=corrugated%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8518130713417%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/industry-designation~3pst-1no-2nc/
2026-01-04 06:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leak-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-rounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/mounting-location~ceiling&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/mounting-location~wall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/number-of-speeds~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8518130713417&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=corrugated%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8518130713417%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22363 pages (at 50 pages/min), scraped 512 items (at 1 items/min)
2026-01-04 06:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/countersink-angle~120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002245268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002266240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leak-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002242856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=983458193638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=countersinks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B983458193638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003441798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7477K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227477K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/panel-cutout-diameter~19-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7987K412&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227987K412%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/panel-cutout-diameter~29-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8518130713417&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=corrugated%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8518130713417%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002209885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-and-hose-carriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/panel-cutout-diameter~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002217293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/left-hand-threaded-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/left-hand-threaded-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6023T16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226023T16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002219775%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counting-drum-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coupling-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leveling-shims/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6023T16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226023T16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~m4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22413 pages (at 50 pages/min), scraped 514 items (at 2 items/min)
2026-01-04 06:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leveling-shims&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-holes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~pharmaceuticals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~sulfur-hexafluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~m5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lever-arm-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~m12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~m4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/wire-connection~butt-splice/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6023T16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226023T16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~m5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/levels/thread-size~m12/
2026-01-04 06:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lever-arm-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/levels/thread-size~m4/
2026-01-04 06:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-pass-throughs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~1-3-8-6-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/wire-connection-type~butt-splices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:47:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6023T16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226023T16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~m18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-type~nh-nst&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/wire-connection-type~butt-splices/
2026-01-04 06:48:06 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~1-3-8-6-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-grease-fitting-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22463 pages (at 50 pages/min), scraped 514 items (at 0 items/min)
2026-01-04 06:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squares/material~cpvc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-grippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-check-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6524T28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226524T28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=creeper-stools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape-number~t10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/limit-switches/actuator-style~cross-roller-plunger/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimpers/power-source~manual&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6524T28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226524T28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~2-1-2-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1141if/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape-number~t10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~30-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1295/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowd-control-railings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453144%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cross-roller-limit-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002067022%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6524T28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226524T28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1141if&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1611K191&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221611K191%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1295&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1815/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22512 pages (at 49 pages/min), scraped 514 items (at 0 items/min)
2026-01-04 06:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/syringes/capacity~10-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1141if/
2026-01-04 06:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crucible-tongs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1295/
2026-01-04 06:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6524T28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226524T28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~2057ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/faucet-stems/for-manufacturer~t-s-brass/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-wrap-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1815&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringes/capacity-weight-~10-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~2721/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1815/
2026-01-04 06:49:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/syringes/capacity-weight-~10-ml/
2026-01-04 06:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~2057ll&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-and-s-brass-faucet-stems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=current-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtain-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3175p/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~387/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~2057ll/
2026-01-04 06:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~2721&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtains/color~dark-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/environment~washdown/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:50:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~2721/
2026-01-04 06:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3175p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~387&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8163625184607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=curtains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8163625184607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002203177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22558 pages (at 46 pages/min), scraped 515 items (at 1 items/min)
2026-01-04 06:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutoff-blade-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutoff-wheels/arbor-hole-size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~3175p/
2026-01-04 06:50:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~387/
2026-01-04 06:50:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8163625184607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=curtains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8163625184607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002203177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtains/color~dark-green&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/environment~washdown-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutoff%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutoff-wheels/arbor-hole-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~t45/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~458/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~40/
2026-01-04 06:50:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/calipers/environment~washdown-1/
2026-01-04 06:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutoff%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutoff-wheels/diameter~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutoff-wheels/for-use-with~straight-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/size~9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/size~t45&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~458&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutoff%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519599%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-cutting~din-rails-with-bracket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutoff%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964426%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/size~9-mm/
2026-01-04 06:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45615A191&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245615A191%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutoff%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:50:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/size~t45/
2026-01-04 06:50:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~458/
2026-01-04 06:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4173A15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224173A15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930114%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4550A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224550A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~767/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~783/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22607 pages (at 49 pages/min), scraped 517 items (at 2 items/min)
2026-01-04 06:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~788/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutoff%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~hastelloy-nickel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~locking-collar/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutting-tool-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~caster/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~767&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~783&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cx96-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~788&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=765203497970&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutoff%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B765203497970%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~767/
2026-01-04 06:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2499A51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222499A51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~783/
2026-01-04 06:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~locking-collar&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~788/
2026-01-04 06:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~caster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~panel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~locking-collar/
2026-01-04 06:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~robotics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~ddl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-couplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~caster/
2026-01-04 06:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-dollies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~da10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~da675/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~fbo29/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~panel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~robotics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22653 pages (at 46 pages/min), scraped 519 items (at 2 items/min)
2026-01-04 06:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~ddl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=da10-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~panel/
2026-01-04 06:52:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-slots/t-slot-framing-component~robotics/
2026-01-04 06:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=da675-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-panel-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~ddl/
2026-01-04 06:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~fbo29&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dc-controllers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dc-drives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~ftd/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~fbo29/
2026-01-04 06:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=camera-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=decals/message~danger-asbestos-may-cause-cancer-causes-damage-to-lungs-authorized-personnel-only&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~q35t4-cl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~ftd&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-tool-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=delrin-af&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=delta-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981597435777&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=decals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981597435777%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-style-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-tape-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:52:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~ftd/
2026-01-04 06:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=57235T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2257235T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~q35t4-cl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~7-5v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~0-23-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~0-676-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=table-leg-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22702 pages (at 49 pages/min), scraped 519 items (at 0 items/min)
2026-01-04 06:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~q35t4-cl/
2026-01-04 06:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~10-4-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=detent-ball-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tabletops/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~7-5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~0-23w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tachometers/environment~dusty&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~0-676w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-board-sensor-modules/sensor-type~gyroscope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978516397099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tabletops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978516397099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~0-23w/
2026-01-04 06:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3018886232025&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tachometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3018886232025%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~0-676w/
2026-01-04 06:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~10-4w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9580658925258&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=development%20board%20sensor%20modules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9580658925258%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005410730%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K197&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K197%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/for-pipe-size~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~10-4w/
2026-01-04 06:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-boards/manufacturer-model-number~mkr-wi-fi-1010&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jigsaws/manufacturer~dewalt-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8184N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228184N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-boards/memory-type~sram&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:53:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/caps/for-pipe-size~12/
2026-01-04 06:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/pipe-size~20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~32-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979761309988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=development%20boards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979761309988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087033%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979761309988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=development%20boards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979761309988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000006507090%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~37-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451116%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22752 pages (at 50 pages/min), scraped 522 items (at 3 items/min)
2026-01-04 06:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1387N24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221387N24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dewalt-jigsaws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1387N302&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221387N302%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~32w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~21eza198&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=car-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~37w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~32w/
2026-01-04 06:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090496%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~37w/
2026-01-04 06:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-404-10e&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-cleaning-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbide-insert-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-flame-arresters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbide-insert-lathe-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-repair-patches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-storage-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-truck-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/asme-expansion-tanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linen-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22805 pages (at 53 pages/min), scraped 524 items (at 2 items/min)
2026-01-04 06:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liquid-electrical-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-tape-measures/length~3-5-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~550-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-grinders/for-use-with~polishing-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/asme-code-expansion-tanks-for-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001592516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linen-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125999%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~750-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-grinders/inlet-pipe-size~1-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8549892642718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=die%20grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8549892642718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carboys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/asme-code-expansion-tanks-for-water/
2026-01-04 06:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-electrical-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7128674698592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=diameter%20tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7128674698592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001592516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-tape-measures/length~3-5-m&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:55:34 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125999%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~550-gal&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126432%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8549892642718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=die%20grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8549892642718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-grinders/for-use-with~polishing-wheels&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 06:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liquid-ptfe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liquid-soap-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~20-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~7-1-2-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~75-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-grinders/inlet-pipe-size~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-967-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:55:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/die-grinders/inlet-pipe-size~1-8/
2026-01-04 06:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cart-bumpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-ptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-soap-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~20-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~7-1-2-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~75-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lockouts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cart-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~20-gal-/
2026-01-04 06:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22851 pages (at 46 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 06:56:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~7-1-2-gal-/
2026-01-04 06:56:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~75-gal-/
2026-01-04 06:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locks/keying~keyed-alike/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locks/lock-type~squeeze-to-release/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locks/lock-type~keyed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-1c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockouts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-aligners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-and-die-wrench-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/keying~keyed-alike&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/lock-type~squeeze-to-release&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/lock-type~keyed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-1c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002063013%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001973656%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453558%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-and-drill-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-charts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~7-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caster-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22899 pages (at 48 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 06:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-splices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-542/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~m34&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diesel-fuel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/blade-lock-type~automatic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453420%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-8060/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-bench-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001927527%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-542&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~7-8-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~72/length~6-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-timer-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-8060&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=catch-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/long-reach-scrapers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diodes/electronic-component-trade-size~do-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-934l-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~6-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~lm1235b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/manufacturer~lord/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tape-measures/length~6-ft-/
2026-01-04 06:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tape-measures/manufacturer-model-number~lm1235b/
2026-01-04 06:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/low-carbon-steel-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=long-reach-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22950 pages (at 51 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 06:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diodes/electronic-component-package~do-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taper-length-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/low-profile-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lord-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/diodes/electronic-component-package~do-27/
2026-01-04 06:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dirt-traps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disconnect-switches/switch-action~maintained/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disc-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-carbon-steel-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-profile-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disinfectant-spray/manufacturer~lysol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disconnect-switches/switch-action~stays-switched-maintained-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disposable-gloves/color~black-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 06:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disinfectant-spray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6617809020615&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=disinfectant%20spray&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6617809020615%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002230768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceiling-tracks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/disconnect-switches/switch-action~stays-switched-maintained-/
2026-01-04 06:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=display-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/manufacturer~bostik/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disposable-putty-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/for-use-on~titanium-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disposable-gloves/color~black&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dissolved-oxygen-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 22998 pages (at 48 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 06:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/thickener~petroleum-wax/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/manufacturer~bostik&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/disposable-gloves/color~black/
2026-01-04 06:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=divider-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/pipe-size~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/for-use-on~titanium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-1-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubriplate-syn-lube-68-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubriplate-synxtreme-fg-2-grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002245017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dock-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/thickener~petroleum-wax&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/taps/for-use-on~titanium/
2026-01-04 06:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454475%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-3-16-20-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003205159%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubriplate-syn-lube-68-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubriplate-synxtreme-fg-2-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1981N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221981N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=centrifugal-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 06:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-3-16-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-bells&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-binders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-rollers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23044 pages (at 46 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 07:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/taps/thread-size~1-3-16-20/
2026-01-04 07:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-tool-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1981N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221981N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~11-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~3-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-sills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-tool-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~3-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1981N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221981N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~7-16-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333442%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape/type~thread-sealant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~7-16-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333517%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnets/color~fluorescent-orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnets/color~off-white-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:00:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1981N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221981N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451072%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dot-shipping-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dope-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/color~fluorescent-orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23095 pages (at 51 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 07:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/color~off-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/chain-grade~100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-rod-air-cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3815738403502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3815738403502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193031%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/magnets/color~off-white/
2026-01-04 07:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8304400284430&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8304400284430%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002058942%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tarps/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval-number~tc-84a-0007/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dovetail-fixtures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-791-adhesives%252fsealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-732-adhesives%252fsealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval-number~tc-84a-1459/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manila-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pin-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tarps/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tc-84a-0007-dust-masks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manual-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tc-84a-1459-dust-masks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tarps/material~fiberglass/
2026-01-04 07:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manila-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tds-(total-dissolved-solids)-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-057&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23144 pages (at 49 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 07:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manual-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-068&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=technora-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-127&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/masks/performance~chemical-resistant-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=technical-pens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-128&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-057&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524957%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-133&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524957%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-127&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-183&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161127%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:45 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-128&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1888&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-201&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mats/for-use-with~water-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mats/form~pillow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-225&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mesh/mesh-size~1-3-1-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:02:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143235%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:02 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-183&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161127%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:06 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1888&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:03:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143235%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-201&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flat-head-made-to-order-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23193 pages (at 49 pages/min), scraped 524 items (at 0 items/min)
2026-01-04 07:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/form~pillow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~1-3-1-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mesh/mesh-size~46-46/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mesh/mesh-size~54-54/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/mats/for-use-with~water/
2026-01-04 07:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002049946%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161127%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-ball-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/flat-head-made-to-order-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/form~pillow&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=85385T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2285385T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~46-46&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~54-54&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-binding-posts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%225131595517480%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002058889%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000161127%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-ball-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-cable-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5100N101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225100N101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9230T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229230T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-binding-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002058889%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drains/for-use-with~calcium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23242 pages (at 49 pages/min), scraped 527 items (at 3 items/min)
2026-01-04 07:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-cable-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968054608189&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968054608189%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circular-saw-blades/for-use-with~rotary-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawbar-eyes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drains/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawer-slides/closed-length~21-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002058889%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawer-slides/closed-length~22-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4589K486&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224589K486%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawing-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968054608189&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968054608189%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9864611406106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawer%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9864611406106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000010616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9864611406106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawer%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9864611406106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031828%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dremel-compatible-circular-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/material~cobalt-steel/flute-direction~left-hand/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dressing-stones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11435A27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211435A27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002058889%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968054608189&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968054608189%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9864611406106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawer%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9864611406106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031828%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~1-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/cobalt-steel-left-hand-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~1-9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=terminal-screw-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509212%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~11-ga-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/cobalt-steel-left-hand-drill-bits/
2026-01-04 07:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509219%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968054608189&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968054608189%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=terminals/wire-connection~stud-terminal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23295 pages (at 53 pages/min), scraped 529 items (at 2 items/min)
2026-01-04 07:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~2-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9864611406106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawer%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9864611406106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031828%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512211%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9784009411319&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=terminals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9784009411319%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-leads/for-fluke-model-number~287&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968054608189&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968054608189%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9864611406106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drawer%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9864611406106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031828%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~3-3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-leads/for-fluke-model-number~289&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6196421921533&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=test%20leads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6196421921533%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~3-35-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~4-1-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6196421921533&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=test%20leads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6196421921533%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130116%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9784009411319&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=terminals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9784009411319%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~43-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509196%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tether-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermal-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9784009411319&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=terminals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9784009411319%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~214-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23348 pages (at 53 pages/min), scraped 529 items (at 0 items/min)
2026-01-04 07:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~8-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermometers/certificate-type~calibration-certificate-traceable-to-nist/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermocouple-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermal-imaging-cameras/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A264&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A264%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509125%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9784009411319&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=terminals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9784009411319%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~222-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~214mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/resistors/resistor-type~thick-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermometers/certification~calibration-certificate-traceable-to-nist&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/length~214mm/
2026-01-04 07:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/thermometers/certification~calibration-certificate-traceable-to-nist/
2026-01-04 07:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermal-imaging-cameras/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-0394&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-073&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thick-film-resistors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-116&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-272&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000020010%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000091786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-388&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000057775%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000090122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~1-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~10-7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermal-imaging-cameras&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000059933%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~12-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097970%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23396 pages (at 48 pages/min), scraped 530 items (at 1 items/min)
2026-01-04 07:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:18 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097970%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~1-3-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/for-use-with~ammonia&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/for-use-with~calcium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~10-7mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~5-75-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~12-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/for-use-with~r-407c-refrigerant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/for-use-with~vegetable-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965242%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~10-7mm/
2026-01-04 07:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~12-2mm/
2026-01-04 07:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-sealants/manufacturer-model-number~5772&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~5-75mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4538K1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224538K1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124209%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~1-1-8-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/shank-size~5-75mm/
2026-01-04 07:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-1-8-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1810A35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221810A35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-12-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455154%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-1-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-3-8-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333464%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23449 pages (at 53 pages/min), scraped 532 items (at 2 items/min)
2026-01-04 07:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-4-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~2-1-4-4-1-2-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:14 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455154%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-1-8-8-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~9-64-41-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/threaded-rods/thread-size~1-1-8-8/
2026-01-04 07:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-stud-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449205%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98935A767&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298935A767%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~12-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~1-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K689&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K689%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~25-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001587524%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001625651%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7597890316846&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=thread%20sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7597890316846%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-caps/tig-industry-number~57y02/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~12-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001587524%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~1-1-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-back-caps/tig-industry-number~57y02&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ties/length~12-ft-/
2026-01-04 07:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~25-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=641637937643&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20back%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B641637937643%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004777943%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-caps/industry-number~57y02&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-gas-diffusers/for-electrode-diameter~0-094&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ties/length~25-ft-/
2026-01-04 07:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23501 pages (at 52 pages/min), scraped 534 items (at 2 items/min)
2026-01-04 07:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-gas-diffusers/for-electrode-diameter~0-156&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tig-torch-caps/industry-number~57y02/
2026-01-04 07:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/for-electrode-diameter~0-094&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995116477386&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20gas%20diffusers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995116477386%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-industry-number~10n46sc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995116477386&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20gas%20diffusers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995116477386%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000040760%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995116477386&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20gas%20diffusers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995116477386%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-gas-diffusers/for-electrode-diameter~0-094&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004778278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995116477386&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20gas%20diffusers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995116477386%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000040760%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-gas-diffusers/for-electrode-diameter~0-156&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-industry-number~53n60sc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-nozzles/tig-industry-number~53n61&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-welding-rods/aws-material-code~er308lsi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tight-clearance-extractors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~10-at5-375&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004779053%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2215634484173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2215634484173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004777879%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997778355701&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997778355701%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tin&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tinning-flux&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997778355701&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997778355701%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-welding-rods/aws-material-code~er308lsi&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tire-air-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tire-chocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toggle-clamp-spindles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23555 pages (at 54 pages/min), scraped 534 items (at 0 items/min)
2026-01-04 07:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=top-mount-track-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/traps/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torx-security-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity~12-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=traffic-stencils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=transfer-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tray-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=traps/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trident-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=&srchtxt=&mixedworld=force&workstationdata=true> (failed 3 times): 500 Internal Server Error
2026-01-04 07:10:37 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <500 https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=&srchtxt=&mixedworld=force&workstationdata=true>: HTTP status code is not handled or not allowed
2026-01-04 07:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trim/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/traps/material~brass/
2026-01-04 07:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=triple-square-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tripod-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trouble-lights/light-technology~incandescent&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/for-use-with~ammonia/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=truckbed-fence&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-bandanas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-brushes/shank-style~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=659715627913&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trouble%20lights&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B659715627913%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968676%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trim/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2308476877744&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2308476877744%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002010453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8424K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228424K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~liquids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23607 pages (at 52 pages/min), scraped 534 items (at 0 items/min)
2026-01-04 07:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/trim/material~brass/
2026-01-04 07:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-use-with~anhydrous-ammonia&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=63505T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2263505T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/system-of-measurement~metric/material~stainless-steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8786789701969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=totes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8786789701969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubs/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~0-04&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tube-fittings/for-use-with~anhydrous-ammonia/
2026-01-04 07:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8424K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228424K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten-carbide-sheet-metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5256N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225256N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubs/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turbine-flowmeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turnbuckle-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8424K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228424K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turnbuckles/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tubs/material~aluminum/
2026-01-04 07:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/twist-ties/color~green-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=turnbuckles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezer-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/tweezer-trade-number~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8424K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228424K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:09 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=turnbuckles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turnbuckles/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twist-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23659 pages (at 52 pages/min), scraped 536 items (at 2 items/min)
2026-01-04 07:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-part-adhesive-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twist-ties/color~green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/tapping-method~thread-cutting/tapping-screw-type~25-bt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3656929274017&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tweezers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3656929274017%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=type-5-web-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/u-bolt-mounting-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=type-6-web-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/twist-ties/color~green/
2026-01-04 07:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:28 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3656929274017&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tweezers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3656929274017%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tweezers/tweezer-trade-number~5&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=type-ee-web-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=type-bt-thread-cutting-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-bolts/u-bolt-mounting-plates-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultra-high-vacuum-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultraviolet-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=umbrellas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=un-compliant-jugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/u-bolts/u-bolt-mounting-plates-6/
2026-01-04 07:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=upholstery-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/audio-adapters/electrical-connection~usb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=urethane-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=usb-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23710 pages (at 51 pages/min), scraped 536 items (at 0 items/min)
2026-01-04 07:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=uv-dryers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=usb-power-delivery-cords/shielding~double-shielded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=usb-audio-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=uv-dye&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-anvil-micrometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~129-h3m-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~1922v484&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2748487824157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=usb%20power%20delivery%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2748487824157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001578263%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295727%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~2pj263&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282494%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5928N19&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225928N19%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283081%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~320j10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~3l190&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~3l290&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~3v1000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~4l460&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283283%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005280958%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~4l550&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~4l760&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5l560&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282318%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5l650&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23766 pages (at 56 pages/min), scraped 537 items (at 1 items/min)
2026-01-04 07:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282128%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5vx1080&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5vx2000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~5vx810&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284305%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~a180&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~a74&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~966-h14m-55&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~aa60&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282393%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~ax51&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005297924%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~ax71&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005280969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~b24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23818 pages (at 52 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~b47&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~b50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~b78&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bb45&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bb116&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281209%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282863%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005312659%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005312935%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bb92&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005312660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~bx91&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~c118&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~cx120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005284710%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpz1162&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpz1312&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281948%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~xpz612&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005282666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~1060-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23873 pages (at 55 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~131&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000133929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~132-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~140&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143299%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~147&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~1487-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000043849%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~46&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000089784%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~86&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 504 Gateway Time-out
2026-01-04 07:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000062070%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:44 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <504 https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005283798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true>: HTTP status code is not handled or not allowed
2026-01-04 07:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~913-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-tube-tees/fitting-connection~barbed-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-breaking-bleed-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/dispenser-type~hand-pump/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~inert-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/valve-type~dual-check&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23927 pages (at 54 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-tube-tees/connection-style~barbed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967870%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variable-speed-electric-mixers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/valve-type~pump&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~513-412-10t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/vacuum-tube-tees/connection-style~barbed/
2026-01-04 07:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002312909%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~543-392&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~543-782&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vehicle-backup-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/valves/valve-type~pump/
2026-01-04 07:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/variance-indicators/manufacturer-model-number~543-392/
2026-01-04 07:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vent-hoods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/variance-indicators/manufacturer-model-number~543-782/
2026-01-04 07:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vents/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ventilated-enclosures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vents/shape~rectangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=venturi-abrasive-blasting-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjustable-parallels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibrating-knife-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibro-pens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibration-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vents/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2491040633414&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vents&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2491040633414%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=viscosity-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/vents/thread-type~unf/
2026-01-04 07:18:09 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2491040633414&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vents&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2491040633414%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002309280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vents/shape~rectangle&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 23980 pages (at 53 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vises/adjustable-parallels-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vises/mount-type~wraparound&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/vises/adjustable-parallels-6/
2026-01-04 07:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=viton-fluoroelastomer-rubber-full-face-flange-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7755808933160&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vises&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7755808933160%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010534%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=voltage-conditioners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wafer-chucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=walk-through-boot-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-calendars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-hydrants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7755808933160&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=vises&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7755808933160%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010534%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vises/mount-type~wraparound&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-mount-cylinder-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timers/mounting-location~wall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=w-beams&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an901-16a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-816/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-mount-stack-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-patches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-plates/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/finish~painted&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-b616/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8003401493577&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wall%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8003401493577%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-d1616/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an901-16a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-816&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-d516/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24028 pages (at 48 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:19:12 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8003401493577&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wall%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8003401493577%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-plates/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an960-d616/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an901-16a/
2026-01-04 07:19:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-816/
2026-01-04 07:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an961-8t/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-b616&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~an970-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-421/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-813b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-d1616&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-d516&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-820b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-b616/
2026-01-04 07:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an960-d616&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-d1616/
2026-01-04 07:19:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-d516/
2026-01-04 07:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an961-8t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-825/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~an970-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an960-d616/
2026-01-04 07:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-421&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms51412-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-813b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms51496p82/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-820b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an961-8t/
2026-01-04 07:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~an970-10/
2026-01-04 07:19:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-421/
2026-01-04 07:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-813b/
2026-01-04 07:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:19:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-820b/
2026-01-04 07:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms15795-825&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-d0432j-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-d0832j-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms51412-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-dn432j-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/military-specifications-met~ms51496p82&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-c0363r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms15795-825/
2026-01-04 07:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-c2432r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms51412-27/
2026-01-04 07:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24072 pages (at 44 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/military-specifications-met~ms51496p82/
2026-01-04 07:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002120490%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-b0663h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0432j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003796674%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0832j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-dn432j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002120490%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-c0363r&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-dn516j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~nas1149-d0432j/
2026-01-04 07:20:30 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003796674%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-c2432r&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:20:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~nas1149-d0832j/
2026-01-04 07:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-f0332p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/specifications-met~nas1149-dn432j/
2026-01-04 07:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-f0732p&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130730%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-dn516j&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1515-h6l-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-b0663h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1515-h8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1515-h9l-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130730%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-f0332p&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas-1/specifications-met~nas620c416/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1515-h04l-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1515-m4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-f0732p&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094071%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146140%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146018%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620c4l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620c416&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/profile~raised-grid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/washer-type~wedge/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24125 pages (at 53 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/washer-type~for-plaster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124728%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080493%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146018%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-containment&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124728%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620c4l&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:21:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080493%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas620c416&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-gear-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/washer-type~raised-grid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/washer-type~wedge-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002146018%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/washer-type~wedge-lock/
2026-01-04 07:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-shock-suppressors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-hardening-tool-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-softener-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wax-pencils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=waterless-hand-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=webbing-snap-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weighing-boats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24178 pages (at 53 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-on-lugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-cape-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-check-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-collet-bodies/tig-industry-number~13n26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-gas-flashback-arresters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-gas-lenses/tig-industry-number~45v24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/aws-material-code~e310&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/aws-material-code~e410&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6935643621703&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20collet%20bodies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6935643621703%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004780456%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5002064948336&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20gas%20lenses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5002064948336%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004778372%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326797%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326028%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6935643621703&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20collet%20bodies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6935643621703%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004780456%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-collet-bodies/tig-industry-number~13n26&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-rods/diameter~0-035&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-table-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-torch-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-wire/aws-material-code~er4043&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5002064948336&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20gas%20lenses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5002064948336%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004778372%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-wire/for-joining~cast-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-brakes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7852200896140&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7852200896140%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7852200896140&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7852200896140%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454217%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-brush-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24233 pages (at 55 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~6-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=winch-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5002064948336&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20gas%20lenses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5002064948336%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004778372%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001939444%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924487%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7852200896140&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7852200896140%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924487%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~6-5-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-collets/tig-industry-number~10n23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=window-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5002064948336&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20gas%20lenses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5002064948336%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004778372%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=window-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/resistivity-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/american-wire-gauge-awg~28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/charging-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-1578/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7852200896140&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7852200896140%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8219223485911&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8219223485911%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6908/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=10n23-welding-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/camera-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=resistivity-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/campbell-hausfeld-compatible-staples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=charging-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1578&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7852200896140&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=welding%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7852200896140%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-1975/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24281 pages (at 48 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6908&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/12-point-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-lifts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=campbell-hausfeld-compatible-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-designation~sjt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1578&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~915d/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~8-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002363733%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-1975&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=12-point-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx81/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8157K62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228157K62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-designation~stow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=915d-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496862%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/commercially-pure-copper-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helical-gear-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003014728%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-177/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/material~936-bearing-bronze/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx81-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8157K62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228157K62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx86/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8201K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228201K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-key-stock-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=commercially-pure-copper-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24325 pages (at 44 pages/min), scraped 537 items (at 0 items/min)
2026-01-04 07:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~a112/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-177&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-alloy-936-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bronze-alloy-954-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8157K62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228157K62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx86-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-key-stock-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524012%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~1-4-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a112-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524012%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-177&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/copper-alloy-110-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-l-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-alloy-954-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8157K62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228157K62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~elb1p201n1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-4-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/15-pin-db-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cans/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-alloy-110-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jackets/performance~metal-detectable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9946103073737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9946103073737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-l-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~elb1p201n1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=15-pin-db-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24370 pages (at 45 pages/min), scraped 538 items (at 1 items/min)
2026-01-04 07:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534857%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-chillers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~1-72/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~elbb003/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-detectable-coats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534857%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-007&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lock-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-compressor-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax78/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-chillers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-3735/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-72&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-205/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~elbb003&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-compressor-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107694%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-compressor-lubricators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax78-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-3735&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-205&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N39&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N39%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bronze-extrusions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505689%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-1-4-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~7305-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524608%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-compressor-lubricators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpvc-glue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24413 pages (at 43 pages/min), scraped 539 items (at 1 items/min)
2026-01-04 07:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524608%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-205&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~2-2525/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-extrusions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~c136/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/length-class~short/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-0020/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~1-173-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~7305-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002092505%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bronze-mesh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~2-2525&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=c136-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/short-length-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~0-0020&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-173-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000081308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-438/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/short-length-drill-bits/
2026-01-04 07:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~0-0020/
2026-01-04 07:27:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dies/thread-size~1-173-18/
2026-01-04 07:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-control-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-mesh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~7512-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~krypton/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axle-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3m-scotch-23-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-438&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24458 pages (at 45 pages/min), scraped 539 items (at 0 items/min)
2026-01-04 07:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-control-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-pipe-reducers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/180xl-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~7512-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~krypton&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axle-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-scotch-23-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142698%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1116456421562&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1116456421562%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964505%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~1-5002/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-pipe-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=180xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-pipe-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compressed-air-moisture-separators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpvc-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compressed-air-regulators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-5002&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chavetas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cap-nuts/thread-size~8-36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-0118/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-0465&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493105%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-pipe-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-moisture-separators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534937%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-diffusers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nuts/thread-size~8-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~0-0118&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24506 pages (at 48 pages/min), scraped 539 items (at 0 items/min)
2026-01-04 07:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~95/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A272&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A272%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-246/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7896753628184&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7896753628184%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bronze-rod-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~0-0118/
2026-01-04 07:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~hhr3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-plates/thickness~0-062/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-diffusers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7896753628184&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7896753628184%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nuts/thread-size~8-36&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cpvc-tube-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~95&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A272&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A272%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-246&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~hhr3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-plates/thickness~0-062&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557270%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-tube-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121719%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9495772993241&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9495772993241%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001457137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-0595&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A272&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A272%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557270%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-246&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-rollers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7051711979057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=helicoils&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7051711979057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cr123a-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compression-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24552 pages (at 46 pages/min), scraped 540 items (at 1 items/min)
2026-01-04 07:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A301&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A301%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A272&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A272%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-061&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-275/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~er207/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bronze-square-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cr123a-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:33 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-061&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-275&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~er207&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-square-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/550-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542152%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/axles/diameter~22-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/copper-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~kr20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002077415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7051711979057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=helicoils&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7051711979057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542152%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-275&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compression-struts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=550-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~22mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/material~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~kr20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~15-16-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chemical-diaphragm-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24597 pages (at 45 pages/min), scraped 541 items (at 1 items/min)
2026-01-04 07:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/vibration-damping-loop-clamps-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/axles/diameter~22mm/
2026-01-04 07:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118548%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/anchors/vibration-damping-loop-clamps-8/
2026-01-04 07:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ansi-40-roller-chain-attachments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-struts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~216-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/material~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7685K3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227685K3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~15-16-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemical-diaphragm-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~1-4-1/diameter~0-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/material~wood/
2026-01-04 07:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-40-roller-chain-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/for-pipe-size~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drums/capacity~4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~216-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/abec-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/caps/for-pipe-size~3/
2026-01-04 07:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~216-000mm/
2026-01-04 07:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/25-pin-db-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemical-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dowel-pins/diameter~1-4/
2026-01-04 07:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~m3-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/for-pipe-size~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity-weight-~4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r09/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abec-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24641 pages (at 44 pages/min), scraped 542 items (at 1 items/min)
2026-01-04 07:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/caps/for-pipe-size~6/
2026-01-04 07:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drums/capacity-weight-~4-gal-/
2026-01-04 07:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=25-pin-db-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~230-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-rivet-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/pin-type~cotter/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~m3-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-013/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-25-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r09&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969789%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000028439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~1-25-mm/
2026-01-04 07:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compressor-air-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~230-000mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-rivet-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-013&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~230-000mm/
2026-01-04 07:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compressor-mufflers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/pipe-size~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-016/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~mn2400/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressor-air-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r10-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7397459384976&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7397459384976%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000116800%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-hoppers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K651&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K651%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressor-mufflers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24685 pages (at 44 pages/min), scraped 542 items (at 0 items/min)
2026-01-04 07:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-016&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~mn2400&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r10-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-hoppers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~mn2500/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/abrasive-cloth/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107338%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-size~m6-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helmet-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130685%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K652&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K652%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71455K62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271455K62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~10-076-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~mn2500&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-cloth&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-spacing~coarse/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~3-5000-mm/diameter~3-500-mm/diameter~3-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~nh12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098417%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bolts/thread-size~m6/
2026-01-04 07:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hemostats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~10-076mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71455K57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271455K57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~11-1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-spacing~coarse&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r16-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~nh12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~3-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~10-076mm/
2026-01-04 07:34:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24731 pages (at 46 pages/min), scraped 546 items (at 4 items/min)
2026-01-04 07:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000153996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079341%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dowel-pins/diameter~3-5mm/
2026-01-04 07:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/captive-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~5-0000-mm/diameter~5-000-mm/diameter~5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~11-100mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bolts/thread-type~unf/
2026-01-04 07:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r16-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6762K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226762K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bonding-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~11-100mm/
2026-01-04 07:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowd-control-gates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=captive-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~28-021-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-159&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/for-knockout-trade-size~1/
2026-01-04 07:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bonding-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r188-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dowel-pins/diameter~5mm/
2026-01-04 07:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bspt-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529510%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowd-control-gates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/abrasive-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chicago-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~28-021mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A233&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A233%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-industry-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crown-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-1718&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~28-021mm/
2026-01-04 07:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bspt-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r188-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24776 pages (at 45 pages/min), scraped 548 items (at 2 items/min)
2026-01-04 07:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540253%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ac-inverters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chicago-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-mop-pails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/knockout-trade-size~pg-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crown-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K167&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K167%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/sanitary-twist-to-lock-knob-style-retractable-spring-plungers-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~7-16-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ac-inverters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-nibblers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-mop-pails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/sanitary-twist-to-lock-knob-style-retractable-spring-plungers-9/
2026-01-04 07:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/for-knockout-trade-size~pg-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boots/protects-against~abrasive-grit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-awg~18-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~r4-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cord-grips/for-knockout-trade-size~pg-16/
2026-01-04 07:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~7-8-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-black-grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~7-16-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-pipe-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-nibblers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dies/thread-size~8-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boots/protects-against~abrasive-grit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~18-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r4-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454867%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9986634754830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9986634754830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002344910%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~7-8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24819 pages (at 43 pages/min), scraped 549 items (at 1 items/min)
2026-01-04 07:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562974%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074220%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-black-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/abs-square-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-pipe-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454626%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K19&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K19%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-007/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/balls/diameter~17-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/rivet-shank-style~snap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-01/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs-square-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chrome-moly-pipe-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/cage-material~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pinch-valves/body-material~acetal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cup-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~17-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/two-piece-push-in-rivets/shank-style~snap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rj-12-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-01&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516627%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chrome-moly-pipe-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%228695524783206%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/cage-material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001465078%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cup-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-pinch-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9528K35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229528K35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295A200&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295A200%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/cage-material~bronze/
2026-01-04 07:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24864 pages (at 45 pages/min), scraped 550 items (at 1 items/min)
2026-01-04 07:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rail-fittings/material~carbon-fiber-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rj-12-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~0-04/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conductive-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acid-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/conduit-type~emt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295A200&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295A200%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~1-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-fiber-rail-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-fiber-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~0-04&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~1-25-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conductive-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acid-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/conduit-type~emt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001457391%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522652%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295A200&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295A200%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/curtains/color~dark-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~1-25mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001566963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-fiber-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A216&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A216%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~1-64-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~1-25mm/
2026-01-04 07:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/access-door-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-safety-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295A200&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295A200%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~0-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24906 pages (at 42 pages/min), scraped 552 items (at 2 items/min)
2026-01-04 07:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~18-01-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/balls/diameter~5-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/balls/diameter~5-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vehicle-mirrors/material~acrylic-plastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~b92/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=access-door-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-safety-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~1-64/
2026-01-04 07:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~18-01mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~5-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~5-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drafting-scales/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acrylic-vehicle-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494307%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=b92-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~18-01mm/
2026-01-04 07:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drafting-stools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536855%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001551975%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/thread-size~m10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K344&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K344%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drafting-supplies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6490K66&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226490K66%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-steel-rod-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drafting-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/balls/diameter~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drafting-stools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-steel-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/thickness~7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24947 pages (at 41 pages/min), scraped 554 items (at 2 items/min)
2026-01-04 07:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drafting-supplies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~2-1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bulkheads/for-use-with~ammonium-hydroxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~7-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~16-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bulkheads/for-use-with~beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~390j10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~2-1mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/for-use-with~ammonium-hydroxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458128%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~16mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~zz-39-211/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/for-use-with~beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~2-1mm/
2026-01-04 07:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963946302057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963946302057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968052%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/material~elastic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~16mm/
2026-01-04 07:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=390j10-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-steel-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963946302057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963946302057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3441N31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223441N31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~vacuum-lifter/for-robot-arm-manufacturer~precise-automation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~zz-39-211&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acetal-copolymer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9087K48&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229087K48%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~395/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 24990 pages (at 43 pages/min), scraped 555 items (at 1 items/min)
2026-01-04 07:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/material~elastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/battery-voltage~14-4v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-steel-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/fitting-type~support-clip/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~vacuum-lifter/manufacturer~precise-automation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N83&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N83%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-copolymer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=395-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7313N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227313N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/voltage~14-4v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~2-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/batteries/voltage~14-4v/
2026-01-04 07:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamshell-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bags/capacity~13-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~l14-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standard-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/voltage~6v-dc-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126238%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/press-fit-drill-bushings-with-head/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/usable-length~12-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=88605K47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2288605K47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001474067%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~13-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/nema-style~l14-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/ball-bearings-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circular-pin-relays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25034 pages (at 44 pages/min), scraped 558 items (at 3 items/min)
2026-01-04 07:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/voltage~6v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/clamping-and-workholding/press-fit-drill-bushings-with-head-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:16 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001474067%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/usable-length~12-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:41:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bags/capacity-weight-~13-gal-/
2026-01-04 07:41:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/ball-bearings-8/
2026-01-04 07:41:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/batteries/voltage~6v/
2026-01-04 07:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~2-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cords/nema-style~l14-30/
2026-01-04 07:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~sjow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-strapping-tie-downs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-nuts/material~acetal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-contacts/for-relay-manufacturer~cutler-hammer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nut-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3d-printer-filaments/material~abs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-nuts/material~polycarbonate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/industry-designation~sjow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-strapping-tie-downs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts/material~acetal-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-structural-framing-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutler-hammer-compatible-electrical-contacts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/industry-designation~sjow/
2026-01-04 07:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/material~abs-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts/material~polycarbonate-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:41:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-nuts/material~acetal-plastic/
2026-01-04 07:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-chargers/battery-voltage~20v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bags/capacity~33-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/3d-printer-filaments/material~abs-plastic/
2026-01-04 07:42:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-nuts/material~polycarbonate-plastic/
2026-01-04 07:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-structural-framing-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25077 pages (at 43 pages/min), scraped 559 items (at 1 items/min)
2026-01-04 07:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bags/weight-capacity~4000-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~28-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-chargers/for-battery-voltage~20v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~33-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-barbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~1-63-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~25mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/battery-chargers/for-battery-voltage~20v/
2026-01-04 07:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-redheads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bags/capacity-weight-~33-gal-/
2026-01-04 07:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~4000-lbs-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~28mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~25mm/
2026-01-04 07:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~tc-er/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit-supports/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bags/capacity-weight-~4000-lbs-/
2026-01-04 07:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-benders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~28mm/
2026-01-04 07:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-63-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carriages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-45-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~34-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013838%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/industry-designation~tc-er&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533751%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjustable-motor-bases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-bevelers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/industry-designation~tc-er/
2026-01-04 07:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25121 pages (at 44 pages/min), scraped 559 items (at 0 items/min)
2026-01-04 07:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carriages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A266&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A266%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~34-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acetal-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~5-525-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-motor-bases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~34-ga/
2026-01-04 07:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawers/drawer-release~without-release/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dumpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-bollards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3d-printer-filaments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bottles/contents-message~flux-remover/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acetylene-torches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~5-525mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamps/clamp-type~c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drawers/drawer-release~none&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dumpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/contents-message~flux-remover&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~5-525mm/
2026-01-04 07:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drawers/drawer-release~none/
2026-01-04 07:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l110/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetylene-torches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-95-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~3-9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7034539236718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7034539236718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148602%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~4-05-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps/clamp-type~c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25163 pages (at 42 pages/min), scraped 560 items (at 1 items/min)
2026-01-04 07:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/color~black-yellow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8998T54&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228998T54%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9791062983264&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9791062983264%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929614%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l110-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/voltage~7-5v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A277&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A277%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~3-9mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~4-05mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/color~black-yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~3-9mm/
2026-01-04 07:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/box-end-wrench-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/diameter~4-05mm/
2026-01-04 07:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ammonia-neutralizers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/amp-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~7-5v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~42-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002192012%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/mounting-location~under-mount/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roller-pipe-hangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/color~orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=box-end-wrench-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ammonia-neutralizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=amp-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~5-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~42mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/mounting-location~under-mount&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-pipe-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/color~orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~42mm/
2026-01-04 07:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casters/environment~washdown/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/e-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25208 pages (at 45 pages/min), scraped 562 items (at 2 items/min)
2026-01-04 07:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002238344%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~5-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~4-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/clamp-type~bolt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acme-threaded-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1716A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221716A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~5-2-mm/
2026-01-04 07:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533250%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/environment-1~washdown&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=e-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001941558%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamps-for-gum-rubber-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A294&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A294%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/casters/environment-1~washdown/
2026-01-04 07:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acme-threaded-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/certification~gs-marked/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1716A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221716A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamshell-pipe-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/material~polyester-elastomer-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps-for-gum-rubber-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A294&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A294%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metallic-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/specifications-met~gs-certified&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1716A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221716A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamshell-pipe-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25255 pages (at 47 pages/min), scraped 562 items (at 0 items/min)
2026-01-04 07:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/material~polyester-rubber-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/specifications-met~gs-certified/
2026-01-04 07:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~7-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A294&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A294%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bumpers/material~polyester-rubber-blend/
2026-01-04 07:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~carbon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metallic-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1716A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221716A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-shipping-tubes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cutters/for-use-on~bronze/
2026-01-04 07:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l440/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/for-use-with~calcium-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/acorn-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~7-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A294&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A294%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clips/mount-type~threaded-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~carbon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boxes/environment~hazardous/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000032429%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bit-shipping-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-end-screwdrivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l440-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/for-use-with~calcium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acorn-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/mount-type~threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3316A32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223316A32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boxes/environment~hazardous-location&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~73-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~61-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-end-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/clips/mount-type~threaded/
2026-01-04 07:47:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/boxes/environment~hazardous-location/
2026-01-04 07:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25301 pages (at 46 pages/min), scraped 563 items (at 1 items/min)
2026-01-04 07:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~57-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/pressure-class~6000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~63-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l640/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~73mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000166983%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~61-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/material~cobalt-steel/shank-type~morse-taper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~57-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=closed-end-hole-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~73mm/
2026-01-04 07:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-caps/specifications-met~asme-b16-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000051999%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~63mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~57-64/
2026-01-04 07:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~2-402/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l640-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6974173590687&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20caps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6974173590687%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134688%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-housing-id~63mm/
2026-01-04 07:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~2-436/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/bracket-type~45-outside-angle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-micrometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l730/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=44605K654&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2244605K654%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metalworking-hammers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~2-402&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roof-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-sets-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~2-436&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/bracket-type~45-outside-angle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/drill-bit-sets-11/
2026-01-04 07:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25344 pages (at 43 pages/min), scraped 563 items (at 0 items/min)
2026-01-04 07:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-micrometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l730-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=44605K654&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2244605K654%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506863%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561627%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metalworking-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89965K861&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289965K861%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrosion-preventers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roof-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8967K171&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228967K171%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roof-vent-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=44605K654&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2244605K654%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/finish~black-oxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/american-wire-gauge-awg~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~7-4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/thread-size~m16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-preventers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~rg-174-u/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/methane-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roof-vent-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=44605K654&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2244605K654%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/finish~black-oxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-gauge~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~7-4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~m16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/activated-carbon-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~3-93/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~rg-174-u&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550737%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable/wire-gauge~10/
2026-01-04 07:49:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/size~7-4-mm/
2026-01-04 07:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25387 pages (at 43 pages/min), scraped 565 items (at 2 items/min)
2026-01-04 07:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope-measures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=methane-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/industry-designation~rg-174-u/
2026-01-04 07:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casters/wheel-diameter~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~m16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=activated-carbon-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~3-93&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clean-room-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edging/profile-shape~corner/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/for-use-on~masonry/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/wheel-diameter~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~cpvc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8978K977&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228978K977%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clean-room-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001921772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~1-8/
2026-01-04 07:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edging/profile~corner&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coated-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckets/capacity~45-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/for-use-on~masonry&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=27935T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2227935T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearing-shims/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/edging/profile~corner/
2026-01-04 07:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~cpvc-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-designation~spt-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-aluminum-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckets/capacity~65-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/coatings/for-use-on~cpvc-plastic/
2026-01-04 07:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-needles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity-weight-~45-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25429 pages (at 42 pages/min), scraped 566 items (at 1 items/min)
2026-01-04 07:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=27935T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2227935T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/id~7-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-shims&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/buckets/capacity-weight-~45-gal-/
2026-01-04 07:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/industry-designation~spt-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-aluminum-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity-weight-~65-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~4-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3m-dp-8010ns-adhesive-cartridges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-needles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire/industry-designation~spt-3/
2026-01-04 07:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=27935T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2227935T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/buckets/capacity-weight-~65-gal-/
2026-01-04 07:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~7-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casters/wheel-type~tread-on-core/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/anchors/thread-size~3-8-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4-25-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/air-hose/id~7-2mm/
2026-01-04 07:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~2-15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-crimping-tools/compatible-with~viega-megapress&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-dp-8010ns-adhesive-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=27935T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2227935T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971791232785&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20crimping%20tools&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971791232785%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137413%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/wheel-type~tread-on-core&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~2-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~2-1-8/
2026-01-04 07:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3m-hot-melt-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25475 pages (at 46 pages/min), scraped 566 items (at 0 items/min)
2026-01-04 07:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-strength-white-pvdf-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~2-15-16/
2026-01-04 07:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/counterbores/screw-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotary-phase-converters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cyanoacrylate-glue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~1-31-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-hot-melt-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/banjo-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counterbores/for-screw-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-phase-converters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~1203/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cyanoacrylate-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/counterbores/for-screw-size~1/
2026-01-04 07:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~1-31-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-brass-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=banjo-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bellows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/category-3-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~1203&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25519 pages (at 44 pages/min), scraped 566 items (at 0 items/min)
2026-01-04 07:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/3m-scotch-70-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-brass-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002147809%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cold-rolled-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~14-to-120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bellows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cleaners/for-use-on~titanium-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotating-connector-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/burs/shape~flame/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-scotch-70-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/burs/shape~flat-top-cone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/belt-rollers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-deburring-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinder-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~14-to-120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~titanium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004099101%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cleaners/for-use-on~titanium/
2026-01-04 07:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotating-connector-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=burs/shape~flame&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=burs/shape~flat-top-cone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=belt-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-shield-blowguns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5626K78&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225626K78%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3908531452254&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3908531452254%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308794%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3908531452254&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3908531452254%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-dryers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barbed-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collection-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25562 pages (at 43 pages/min), scraped 567 items (at 1 items/min)
2026-01-04 07:53:14 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3908531452254&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3908531452254%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308794%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=burs/shape~flame&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinders/body-material~aluminum-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:16 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3908531452254&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3908531452254%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=burs/shape~flat-top-cone&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/number-of-poles~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-shield-blowguns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-elbows/fitting-connection~compression-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~dl1616/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barbed-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-glands/thread-size~m6-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/specifications-met~ccpa-standard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinders/body-material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~1602-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/number-of-poles~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002050137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-elbows/connection-style~compression&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dl1616-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cylinders/body-material~aluminum/
2026-01-04 07:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/fitting-connection~quick-clamp-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-glands/thread-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536690%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-elbows/connection-style~compression/
2026-01-04 07:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clear-packing-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:53:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable-glands/thread-size~m6/
2026-01-04 07:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barbed-tube-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~50-05-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~1602-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~60-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cylinders/mounting-location~surface/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/connection-style~quick-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~54-9994-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25603 pages (at 41 pages/min), scraped 567 items (at 0 items/min)
2026-01-04 07:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/elbows/connection-style~quick-clamp/
2026-01-04 07:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/pipe-size~3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clear-packing-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~50-05mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~60mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinders/mounting-style~surface&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~54-9994mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~50-05mm/
2026-01-04 07:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brady-bmp21-label-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/for-shaft-diameter~60mm/
2026-01-04 07:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cylinders/mounting-style~surface/
2026-01-04 07:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brady-label-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~54-9994mm/
2026-01-04 07:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/pipe-size~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/pipe-material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clear-vinyl-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-torque-ratchet-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bench-top-mount-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/braided-line/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brady-bmp21-label-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/adapters/for-tube-od~4/
2026-01-04 07:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brady-label-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/for-pipe-material~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clear-vinyl-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~50-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/airway-buffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bench-top-mount-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=braided-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/elbows/for-pipe-material~copper/
2026-01-04 07:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25646 pages (at 43 pages/min), scraped 567 items (at 0 items/min)
2026-01-04 07:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/router-tables/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clevis-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=color-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~50-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/benders/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-identification-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=airway-buffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-0935/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/air-hose/length~50-ft-/
2026-01-04 07:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=router-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clevis-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/document-frames/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-identification-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~11-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=benders/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~1623-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-0935&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cellulose-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/benders/material~aluminum/
2026-01-04 07:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/angle-needle-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000040397%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=document-frames&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barrel-nipples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rtd-surface-probes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/pipe-size~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~1623-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25685 pages (at 39 pages/min), scraped 567 items (at 0 items/min)
2026-01-04 07:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cellulose-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/for-shaft-diameter~11-16/
2026-01-04 07:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~14-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~0-147/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-needle-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rtd-surface-probes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose-blowers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrel-nipples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/pipe-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/for-use-on~tool-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~14mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~0-147&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~d371/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dollies/body-material~aluminum-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/for-shaft-diameter~14mm/
2026-01-04 07:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151124%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/for-use-on~tool-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/pipe-size~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-hex-broaches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/for-use-on~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~1654-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=983458193638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B983458193638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dollies/body-material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=d371-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/countersinks/for-use-on~wood/
2026-01-04 07:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25730 pages (at 45 pages/min), scraped 567 items (at 0 items/min)
2026-01-04 07:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/pipe-size~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-hex-broaches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dollies/body-material~aluminum/
2026-01-04 07:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3236610467807&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3236610467807%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489937%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/4-point-drive-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/400-5mm-timing-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~1654-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047728%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 07:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barriers/material~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080910%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~2205-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bushing-lock-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4-point-drive-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=400-5mm-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dampers/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=highway-guardrails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/material~leather&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/fitting-type~union-1/body-shape~hex-with-lugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~41-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~2205-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ansi-butterfly-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-alloy-316-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:57:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/barriers/material~leather/
2026-01-04 07:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001919079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000138546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dampers/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~46-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135791%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barriers/material~zinc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~9-1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4513K112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224513K112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dampers/material~fiberglass/
2026-01-04 07:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-alloy-353-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3236610467807&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3236610467807%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489952%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25775 pages (at 45 pages/min), scraped 567 items (at 0 items/min)
2026-01-04 07:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-butterfly-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-alloy-316-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~41-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-powered-chisels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barriers/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~9-100mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/drive-size~41-mm-1/
2026-01-04 07:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-alloy-353-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/frame-fittings/framing-type~clamp-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-can-crushers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998883551574&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998883551574%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/id~9-100mm/
2026-01-04 07:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~42-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulon-lr-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-chisels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-composites/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/overall-length~1-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/clamp-on-framing-and-fittings-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-1564/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-can-crushers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~42mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulon-lr-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223037331919664%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~0-1564/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/for-shaft-diameter~42mm/
2026-01-04 07:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-composites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:03 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~1-1-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 07:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~1-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6297N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226297N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-1564&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rust-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25820 pages (at 45 pages/min), scraped 568 items (at 1 items/min)
2026-01-04 07:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618086%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-1564&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-powered-vacuum-lifters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-screw-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-guides/connection-method~clamp-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compact-flow-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ansi-safety-tags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000133010%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rust-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=160493878362&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20guides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B160493878362%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361622%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ceramic-blanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/entry-door-hinges/pin-type~lift-off/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-vacuum-lifters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-screw-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-presses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-safety-tags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clips/finish~zinc-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-blanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/lift-off-entry-door-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 07:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-louvers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/material~carbon-fiber-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sa-spool-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~3001-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%221510659569138%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003423553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25864 pages (at 44 pages/min), scraped 569 items (at 1 items/min)
2026-01-04 08:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/finish~zinc-chromate-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1849A62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221849A62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-louvers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2183N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222183N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sa-spool-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/clips/finish~zinc-chromate-plated/
2026-01-04 08:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-1887/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3001-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~9-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-point-gauges/manufacturer~starrett-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/military-specification~ms20822-16k/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~m14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130744%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-1887&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=composite-shapes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506167%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/fitting-type~union-1/pipe-size~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~9mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-point-gauges/manufacturer~starrett&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/specifications-met~ms20822-16k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/antifriction-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~m14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001919079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/for-shaft-diameter~9mm/
2026-01-04 08:01:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-point-gauges/manufacturer~starrett/
2026-01-04 08:01:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/elbows/specifications-met~ms20822-16k/
2026-01-04 08:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/antiseize-compounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25909 pages (at 45 pages/min), scraped 571 items (at 2 items/min)
2026-01-04 08:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/overall-length~18-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-slides/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clips/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4464K485&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224464K485%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-spacers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antifriction-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~1-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antiseize-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~18-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/antiseize-lubricating-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-speed-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~0-378/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/clips/material~steel/
2026-01-04 08:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/deadman-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~4l380/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/4l400-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antiseize-lubricating-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-speed-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/deburring-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-378&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=deadman-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084212%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4l380-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25953 pages (at 44 pages/min), scraped 572 items (at 1 items/min)
2026-01-04 08:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~20-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4l400-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=deburring-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~20-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~185-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084212%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~m70/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~20-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~50-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~1-1-2-6-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-wool/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/black-iron-pipe-tees/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~20-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~185-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084212%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~m70&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable-ties/length~20-ft-/
2026-01-04 08:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~50mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:02:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/containers/capacity-weight-~185-gal-/
2026-01-04 08:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~1-1-2-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-wool&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=black-iron-pipe-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/alcohol-bottles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/couplings/for-shaft-diameter~50mm/
2026-01-04 08:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~3038-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/thread-size~1-1-2-6/
2026-01-04 08:03:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084212%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 25996 pages (at 43 pages/min), scraped 572 items (at 0 items/min)
2026-01-04 08:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~calcium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~12-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dot-labels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/overall-length~30-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electric-grease-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alcohol-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3038-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~12-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dot-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~30-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-grease-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/crowfeet/size~1-4/
2026-01-04 08:03:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~12-5mm/
2026-01-04 08:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001604457%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blade-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cga-500-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electric-grinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~ethanol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-steel-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167882%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/for-use-with~ethylene-glycol-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26038 pages (at 42 pages/min), scraped 572 items (at 0 items/min)
2026-01-04 08:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drilled-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blade-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-500-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-steel-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:04:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167882%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~0-688/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cga-540-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~ethylene-glycol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/allen-bit-impact-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-steel-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-hole-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-t-slot-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-fittings/for-use-with~ethylene-glycol/
2026-01-04 08:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-hollow-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-688&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/signs/message~additional-parking-in-rear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cga-540-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-tamper-resistant-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=allen-bit-impact-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-steel-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-hole-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000049465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-t-slot-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-hollow-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=additional-parking-in-rear-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~2-157-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26082 pages (at 44 pages/min), scraped 572 items (at 0 items/min)
2026-01-04 08:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clothing-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-window-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/compression-tube-elbows/fitting-connection~flared-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~0-754/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-tamper-resistant-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~28-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-321/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021679%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~2-157-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clothing-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-window-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-tube-elbows/connection-style~flared&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-754&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~4l970/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5029N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225029N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/thread-size~2-157-18/
2026-01-04 08:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/for-use-with~isopropyl-alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-321&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/compression-tube-elbows/connection-style~flared/
2026-01-04 08:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000066303%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/saline-concentrates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965701%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/saline-solution/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/overall-length~5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~2-4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493702%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/overall-length~5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4l970-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-mesh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saline-solution&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saline-concentrates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26124 pages (at 42 pages/min), scraped 573 items (at 1 items/min)
2026-01-04 08:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~2-75-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~2-4mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/blades/blade-type~retracting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-thrust-roller-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001628588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-mesh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~2-4mm/
2026-01-04 08:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/cable-ties/length~5-8/
2026-01-04 08:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/arc-welding-supplies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-368/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001628588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~5-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~2-75mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~3-8-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/blade-type~retracting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-thrust-roller-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/argon-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/number-of-pieces~19/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~2-75mm/
2026-01-04 08:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-brushes/handle-material~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982658580091&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982658580091%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-368&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesive-back-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metric-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4929A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224929A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=argon-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~19&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500167%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-brushes/handle-material~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-386/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-cable-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553648%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A238&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A238%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26167 pages (at 43 pages/min), scraped 573 items (at 0 items/min)
2026-01-04 08:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-back-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wire-brushes/handle-material~wood/
2026-01-04 08:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4929A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224929A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553648%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~19&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l230/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-386&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesive-dispensing-tips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~12b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cabinet-cages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~1763-ba/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499841%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/length~9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4929A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224929A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l230-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cable-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-dispensing-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~12b-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~1763-ba&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~hydrogen-iodide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/for-use-with~hydrogen/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:07:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4929A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224929A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:07:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chain/roller-chain-trade-size~12b-ss/
2026-01-04 08:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/number-of-pieces~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~7-8-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~8-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~7-8-1-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/bearings/bearing-trade-number~6005-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~hydrogen-iodide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26210 pages (at 43 pages/min), scraped 574 items (at 1 items/min)
2026-01-04 08:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~hydrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967215%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967523%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~7-8-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/bearings/bearing-trade-number~6005-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333387%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/overall-width~7-8/
2026-01-04 08:08:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6005-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammers/manufacturer~dewalt-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-wheel-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-troughs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l360/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-75-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6005-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dewalt-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-wheel-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112478%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-troughs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l360-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concentric-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086088%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26255 pages (at 45 pages/min), scraped 575 items (at 1 items/min)
2026-01-04 08:09:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~0-75-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~4-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~m120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~0-75-mm/
2026-01-04 08:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanding-sticks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-1893/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-conduit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calibrated-timers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l520/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pry-resistant-lockout-hasps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~4-55mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-1893&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-conduit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calibrated-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000016687%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l520-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~4-55mm/
2026-01-04 08:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451964%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000012141%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/pry-resistant-lockout-hasps-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer~starrett-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanding-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/manufacturer-model-number~02azd730g-c/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hinges/pry-resistant-lockout-hasps-7/
2026-01-04 08:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/bolt-clearance-type~extra-deep/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26298 pages (at 43 pages/min), scraped 575 items (at 0 items/min)
2026-01-04 08:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l650/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-coils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/material~304-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/range-of-motion~200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer~starrett&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~1-9-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~02azd730g-c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510515%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dial-indicators/manufacturer~starrett/
2026-01-04 08:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/bolt-clearance-style~extra-deep&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l650-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2332N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222332N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/bolt-clearance-style~extra-deep/
2026-01-04 08:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~1-9-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum/temper-designation~h19/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~5-75-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~1-9-32/
2026-01-04 08:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/asme-hex-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/manufacturer-model-number~06aeg431/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~porcelain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6202-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~1-3-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/temper~h19&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=asme-hex-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5l830/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26342 pages (at 44 pages/min), scraped 576 items (at 1 items/min)
2026-01-04 08:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-5781/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~06aeg431&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489862%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~porcelain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6202-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/aluminum/temper~h19
2026-01-04 08:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-loaded-latches/material~brass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078187%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5l830-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-5781&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/asphalt-patches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500195%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/micrometer-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bobbins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-spring-loaded-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/assembled-workbenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-grade-plastics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/material~plastic-1/material~cpvc/pipe-schedule~80&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A550&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A550%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=asphalt-patches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/shank-size~7-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bobbins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~2/
2026-01-04 08:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micrometer-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=assembled-workbenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-grade-plastics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26384 pages (at 42 pages/min), scraped 577 items (at 1 items/min)
2026-01-04 08:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/saw-guides/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/5v1250-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hitch-inserts-for-forklift-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/pipe-size~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/shank-size~7-8mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6211-2rs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/astm-a194-hex-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saw-guides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5v1250-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/shank-size~7-8mm/
2026-01-04 08:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5v630/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/pipe-size~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-6885/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6211-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~pg-42-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/pipe-size~3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-a194-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~2-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095833%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5v630-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-6885&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~pg-42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/formulation~neoprene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/pipe-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26429 pages (at 45 pages/min), scraped 577 items (at 0 items/min)
2026-01-04 08:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~2-5-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/manufacturer-model-number~513-443-16a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/performance~electrically-insulating-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498629%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bushings/thread-size~pg-42/
2026-01-04 08:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/anvil-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/5v950-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/drive-size~2-5-16-1/
2026-01-04 08:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/pressure-class~6000/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/formulation~neoprene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-7344/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-443-16a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulating-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/control-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anvil-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5v950-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084490%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/pressure-class~6000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7610A16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227610A16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-asme-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~22-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000166983%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=control-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~100/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/astm-b355-copper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/apple-iphone-compatible-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~627/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003490110%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brass-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-asme-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26471 pages (at 42 pages/min), scraped 578 items (at 1 items/min)
2026-01-04 08:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-754/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/appliance-snap-acting-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-b355-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=apple-iphone-compatible-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~627&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aqua-ammonia/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~100/
2026-01-04 08:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6301/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086593%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-754&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cold-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=appliance-snap-acting-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cold-resistant-clothing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aqua-ammonia&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-073/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6301&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/thread-size~1-2-13/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cold-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cold-resistant-clothing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-073&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-outlets/outlet-box-component~cover/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-rings/pin-type~quick-release&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/thread-size~1-2-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-082/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/button-dies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26516 pages (at 45 pages/min), scraped 578 items (at 0 items/min)
2026-01-04 08:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/5vx850-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-guide-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6716761090215&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hoist%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6716761090215%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~40-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526682%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-073&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-outlets/outlet-box-component~cover&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-082&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=button-dies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~40-ss/
2026-01-04 08:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5vx850-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/manufacturer-model-number~798a-8-200/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-guide-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collet-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scale-scoops/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2359415142990&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2359415142990%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364276%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~2-7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-cutters/manufacturer-model-number~622n&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:48 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001553507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-082&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3191198586024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire%20cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3191198586024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~798a-8-200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2359415142990&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2359415142990%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364276%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-outlets/outlet-box-component~cover&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/finish~dyed/color~green-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collet-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scale-scoops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~2-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~46-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dial-indicators/mount-type~dovetail/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141495%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-r-24243%252f1e-a401-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~2-7-16/
2026-01-04 08:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489952%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26564 pages (at 48 pages/min), scraped 578 items (at 0 items/min)
2026-01-04 08:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/finish~green-dyed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/breakers/current~32-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~permabond/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/button-heads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-rings/thread-size~3-4-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-9063/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/mount-type~dovetail&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bolts/finish~green-dyed/
2026-01-04 08:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/schlage-m492-electromagnetic-door-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6716761090215&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hoist%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6716761090215%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-links/roller-chain-trade-number~c2060h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers/current~32a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~permabond&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=button-heads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~56-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-9063&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:44 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/mount-type~dovetail&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:16:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/breakers/current~32a/
2026-01-04 08:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002258298%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=schlage-m492-electromagnetic-door-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/armor-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~1-5-16-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-size~c2060h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/astm-set-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/armored-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98042A837&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298042A837%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chain-links/roller-chain-trade-size~c2060h/
2026-01-04 08:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diamond-coated-router-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=armor-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26606 pages (at 42 pages/min), scraped 578 items (at 0 items/min)
2026-01-04 08:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pins/diameter~0-110/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~1-5-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-set-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connector-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=armored-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/signal-type~data/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diamond-coated-router-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-strain-relief/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjustable-collars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/calipers/manufacturer-model-number~s579gz/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~129-9994-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/application~ethernet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539669%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~2-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~13-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-strain-relief&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8659884989431&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drive%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8659884989431%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400784%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-collars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calipers/manufacturer-model-number~s579gz&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~129-9994mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/7075-aluminum-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~2-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~13-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~e18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8826536049195&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8826536049195%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083527%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~129-9994mm/
2026-01-04 08:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26651 pages (at 45 pages/min), scraped 579 items (at 1 items/min)
2026-01-04 08:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mil-spec-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000046723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~14-03-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2081A8&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222081A8%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=7075-aluminum-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3671N123&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223671N123%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/drive-size~e18-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/military-specification~ms51575-21/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-spec-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~14-03mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/drive-size~e18-1/
2026-01-04 08:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx29/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-drilling-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct/component~airflow-damper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~1-7-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screen-door-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bearings/od~14-03mm/
2026-01-04 08:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~1-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/specifications-met~ms51575-21&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-metering-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx29-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-drilling-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~airflow-damper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~1-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/bolts/specifications-met~ms51575-21/
2026-01-04 08:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screen-door-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-duct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~1-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002262697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/combination-wrenches/size~1-7-16/
2026-01-04 08:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-diggers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-metering-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26696 pages (at 45 pages/min), scraped 581 items (at 2 items/min)
2026-01-04 08:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/combination-wrenches/size~1-7-8/
2026-01-04 08:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/british-standard-low-pressure-bronze-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bx40-v-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chamfering-countersinks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=80%252f20-compatible-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/auxiliary-contacts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=british-standard-low-pressure-bronze-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/bearing-trade-number~6901-2z/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/specifications-met~iso-228-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx40-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chamfering-countersinks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screw-conveyors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=auxiliary-contacts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/thread-size~9-16-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/british-standard-thread-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6901-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4092K711&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224092K711%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drilling-hammers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~1-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx50-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-conveyors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26739 pages (at 43 pages/min), scraped 581 items (at 0 items/min)
2026-01-04 08:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~9-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=british-standard-thread-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax120-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4092K711&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224092K711%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drilling-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-tools/manufacturer~chapin/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mil-spec-s-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-hole-diameter~1-3-4/
2026-01-04 08:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/auger-conveyors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~13-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4092K711&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224092K711%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chapin-battery-chargers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/automatic-drain-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-spec-s-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contact-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=auger-conveyors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-measurers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:20:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4092K711&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224092K711%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~0-032/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=automatic-drain-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-hole-diameter~13-16/
2026-01-04 08:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~27-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26784 pages (at 45 pages/min), scraped 581 items (at 0 items/min)
2026-01-04 08:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~0-070/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~0-072/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~29-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fire-hose-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/back-braces/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~0-0320&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~27mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~0-0320/
2026-01-04 08:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~0-0720&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~29mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~0-070&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/thread-type~un-unf-sae-straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-hose-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-hole-diameter~2/
2026-01-04 08:21:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-hole-diameter~27mm/
2026-01-04 08:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/backpack-misters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=back-braces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~0-0720/
2026-01-04 08:21:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-hole-diameter~29mm/
2026-01-04 08:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~0-070/
2026-01-04 08:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-grade-buckets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~union-1/fitting-connection~threaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mineral-wool/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=backpack-misters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-use-on~masonry&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-grade-buckets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-and-cord-measurers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~union-1/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/connection-style~threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mineral-wool&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26830 pages (at 46 pages/min), scraped 581 items (at 0 items/min)
2026-01-04 08:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-fittings/type~union/connection-style~threaded/
2026-01-04 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-transfer-conveyors-and-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/hole-diameter~18-6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/for-use-on~plastic-1/for-use-on~nylon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002237077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belts/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-transfer-conveyors-and-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-fittings/type~union/material~bronze/
2026-01-04 08:22:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~nylon-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3496939935355&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3496939935355%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/for-use-on~plastic-1/for-use-on~polypropylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/miniature-idler-rollers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/goo-gone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/glue/for-use-on~nylon-plastic/
2026-01-04 08:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/hole-diameter~29-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~no-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~polypropylene-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-guides-mounting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-idler-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=goo-gone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/hole-diameter~50-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26880 pages (at 50 pages/min), scraped 581 items (at 0 items/min)
2026-01-04 08:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/glue/for-use-on~polypropylene-plastic/
2026-01-04 08:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~t100/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~no-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002246770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealing-rivet-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-flanges/pipe-size~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/size~no-30/
2026-01-04 08:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-flanges/pressure-class~6000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sprockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~t100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hollow-pin-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-flanges/specifications-met~din-86030&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8358603820791&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8358603820791%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000046129%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8358603820791&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8358603820791%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000166983%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drive-sockets/size~t100/
2026-01-04 08:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing-rivet-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8358603820791&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8358603820791%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142276%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1153T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221153T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-gaskets/pipe-size~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-gaskets/pipe-size~5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-spool-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mirrors/shape~triangle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1132T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221132T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cooling-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26929 pages (at 49 pages/min), scraped 583 items (at 2 items/min)
2026-01-04 08:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-gaskets/for-pipe-size~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-gaskets/for-pipe-size~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drop-legs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mirrors/shape~triangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hones/for-use-on~stone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/baseball-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-alloys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-gaskets/for-pipe-size~5/
2026-01-04 08:24:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pipe-gaskets/for-pipe-size~3/
2026-01-04 08:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~3-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6828105263257&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6828105263257%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1080139871402&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hones&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1080139871402%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930162%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/self-aligning-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~4-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mitutoyo-compatible-indicator-backs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:36 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6828105263257&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6828105263257%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mirrors/shape~triangle&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4509A2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224509A2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=baseball-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/self-retracting-polyurethane-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-glands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~3-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-crimping-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-aligning-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~4-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mitutoyo-compatible-indicator-backs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:24:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~3-1-8/
2026-01-04 08:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/enclosure-rating~ip65/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=self-retracting-polyurethane-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~4-3-4/
2026-01-04 08:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mitutoyo-spc-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-crimping-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 26975 pages (at 46 pages/min), scraped 584 items (at 1 items/min)
2026-01-04 08:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/environmental-rating~ip65&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-wrap-terminals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-tabs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mitutoyo-spc-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/environmental-rating~ip65/
2026-01-04 08:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~7-mm/
2026-01-04 08:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hooks/application~for-lifting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mixers/for-use-with~soluble-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/servomotor-shaft-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hooks/attachment-type~plain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/setup-clamp-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mixers/for-use-with~soluble-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002012536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003934188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/diameter~1-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-insulation-strapping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/diameter~1-3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=servomotor-shaft-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=setup-clamp-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/for-use-with~soluble-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sewer-drain-grate-guards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wonderstone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003934188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/diameter~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27021 pages (at 46 pages/min), scraped 584 items (at 0 items/min)
2026-01-04 08:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8018988495419&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8018988495419%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179259%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sewer-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000010007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9977K6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229977K6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sewer-drain-grate-guards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mixing-nozzles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003934188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-joint-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sewer-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/beaded-ties/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shadow-box-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/mixer-nozzles-for-two-part-adhesive-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003934188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/mixers/mixer-nozzles-for-two-part-adhesive-cartridges/
2026-01-04 08:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hopper-magnets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shadow-box-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~300v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shank-hooks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/beam-load-cells/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-tippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearing-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553753%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mixing-valves-for-shower-stations/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27069 pages (at 48 pages/min), scraped 586 items (at 2 items/min)
2026-01-04 08:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shank-hooks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beam-load-cells&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=horsehair-wheel-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sheave-alignment-lasers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixing-valves-for-shower-stations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corner-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearing-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheave-alignment-lasers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/fitting-connection~ball-socket/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corner-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/diameter~6-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sheet-metal-power-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/fitting-connection~press-fit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-plumbing-fixture~dishwasher&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010781%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/connection-type~ball-socket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~6-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheet-metal-power-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrosion-resistant-compression-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054800%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10095K149&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210095K149%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/connection-type~ball-socket/
2026-01-04 08:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity~28-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001534486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27118 pages (at 49 pages/min), scraped 586 items (at 0 items/min)
2026-01-04 08:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mobil-rarus-427-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~9-4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2857K361&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222857K361%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3968674775186&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drums&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3968674775186%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141609%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/for-use-on~ceramic-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4002A116&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224002A116%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3968674775186&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drums&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3968674775186%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141609%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/capacity~28-gal&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobil-rarus-427-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cotter-pins/cotter-pin-type~hammer-set&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~9-4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2857K361&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222857K361%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~1-750-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/for-use-on~ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965550%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8379223820218&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cotter%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8379223820218%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001606269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498019%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/length~25-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hole-saws/for-use-on~ceramic/
2026-01-04 08:28:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8379223820218&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cotter%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8379223820218%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001606269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cotter-pins/cotter-pin-type~hammer-set&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7859T71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227859T71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96977A342&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296977A342%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2857K361&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222857K361%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wood%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001613653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~1-75mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/certification~c-ul-listed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/thickness~1-75mm/
2026-01-04 08:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/enclosure-rating~nema-4x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/length~60-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7859T71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227859T71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shock-absorber-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5519429302621&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=counters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5519429302621%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002254507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2857K361&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222857K361%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shock-absorbing-decelerators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5519429302621&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=counters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5519429302621%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000093762%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wood%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616508%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27168 pages (at 50 pages/min), scraped 589 items (at 3 items/min)
2026-01-04 08:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~1-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7859T71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227859T71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shock-absorber-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shock-absorbing-decelerators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/krytox/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/length~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~1-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drums/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-03125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001607234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/length~9-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-03125inches/
2026-01-04 08:29:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7859T71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227859T71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=krytox&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001592969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/length~96&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums-with-drains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/modeling-clay/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shop-vac-906-73-vacuum-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4830K413&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224830K413%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/screw-size~no-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623313%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drums/material~aluminum/
2026-01-04 08:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wood%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27218 pages (at 50 pages/min), scraped 590 items (at 1 items/min)
2026-01-04 08:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5438N24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225438N24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/beverage-coolers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=modeling-clay&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shop-vac-906-73-vacuum-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:21 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bicycle-flags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/pipe-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-nipples-and-pipe/pipe-size~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bicycle-seats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricant-sticks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mold-release-additives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beverage-coolers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=525781165543&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20nipples%20and%20pipe&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B525781165543%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000046129%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bicycle-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dryers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-desks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricant-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mold-release-additives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-use-on~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bicycle-seats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shredders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~citric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/molds/material~bismuth/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27262 pages (at 44 pages/min), scraped 591 items (at 1 items/min)
2026-01-04 08:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/work-lights/mounting-location~stake/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-198/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-use-on~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~13-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drywall-mud&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shredders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-16inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/lubricants/for-use-on~aluminum/
2026-01-04 08:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=molds/material~bismuth-alloy&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-16inches/
2026-01-04 08:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-lights/mount-type~stake&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/biohazard-receptacles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-198inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/molds/material~bismuth-alloy/
2026-01-04 08:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-203125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/black-iron-pipe-crosses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/work-lights/mount-type~stake/
2026-01-04 08:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-198inches/
2026-01-04 08:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-256/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~24-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-203125inches/
2026-01-04 08:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dual-language-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=biohazard-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicon-nitride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/monel-threaded-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002280368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=black-iron-pipe-crosses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-plugs/specifications-met~asme-b31-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-256inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=52195K278&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2252195K278%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8841143350592&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pipe%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8841143350592%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicon-nitride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-256inches/
2026-01-04 08:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27311 pages (at 49 pages/min), scraped 591 items (at 0 items/min)
2026-01-04 08:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=monel-threaded-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002280368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5232T449&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225232T449%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~krytox-1506/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~ceiling-mounting-bracket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-308&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=52195K278&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2252195K278%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002238800%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493508%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbenches/mobility~mobile/top-material~stainless-steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002280368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5232T449&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225232T449%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1823T81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221823T81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~krytox-1506&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K405&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K405%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8316204383934&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=workbenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8316204383934%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002209688%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbenches/mounting-location~wall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=52195K278&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2252195K278%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089312%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002242974%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002280368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8316204383934&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=workbenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8316204383934%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002266240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5232T449&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225232T449%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/monitors/connects-to~pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2117K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222117K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct/component~two-device-2-gang-raised-outlet-box-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=52195K278&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2252195K278%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-345&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27362 pages (at 51 pages/min), scraped 594 items (at 3 items/min)
2026-01-04 08:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~lb-8065-c5-a-copper-based-anti-seize/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~security-strap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5232T449&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225232T449%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mop-bucket-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=monitors/connection-type~pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/component~two-device-2-gang-raised-outlet-box&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002271430%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/trade-name~lps-no-1-greaseless/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=worker-positioning-lanyards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K364&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K364%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/monitors/connection-type~pipe/
2026-01-04 08:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/duct/component~two-device-2-gang-raised-outlet-box/
2026-01-04 08:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~lb-8065-c5-a-copper-based-anti-seize&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71865K461&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271865K461%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mop-bucket-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/siphon-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/morse-taper-tap-drivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143896%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~lps-no-1-greaseless&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=worm-drive-clamps-for-soft-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002134155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-routers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/skil-saw-replacement-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=siphon-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=morse-taper-tap-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1200K21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221200K21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K7&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K7%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27411 pages (at 49 pages/min), scraped 596 items (at 2 items/min)
2026-01-04 08:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrench-caddies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrench-organizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct/gauge~26/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boiler-blow-down-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=skil-saw-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sling-protectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/motor-shafts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/material~brass-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/material~cotton-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bondable-ptfe-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct/gauge~26-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boiler-blow-down-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7160092992292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7160092992292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003432833%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-tap-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motor-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/duct/gauge~26-ga/
2026-01-04 08:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-thread-sealers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9147T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229147T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/drive-size~24-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=53025K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2253025K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bondable-ptfe-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sling-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003490026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/small-parts-suction-cup-lifters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boring-bar-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutting-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mounted-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27456 pages (at 45 pages/min), scraped 599 items (at 3 items/min)
2026-01-04 08:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mounted-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutting-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~52-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-belleville-spring-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=small-parts-suction-cup-lifters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-warmers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boring-bar-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mounted-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mounted-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/drive-size~52-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/movie-screens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~15-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-122116-helical-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipettor-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/drive-size~52-mm-1/
2026-01-04 08:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/military-specification~ms122132/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-fittings/duct-size~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-122159-helical-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-end-swage-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=movie-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~15-3125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8654208980817&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=duct%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8654208980817%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002015725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-122116-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-122132-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~15-3125inches/
2026-01-04 08:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27504 pages (at 48 pages/min), scraped 599 items (at 0 items/min)
2026-01-04 08:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-122159-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-124698-helical-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dc-barrel-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/drive-size~t100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder-joint-socket-weld-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder-mask/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-end-swage-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~5-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-124698-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brewers-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=planing-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-joint-socket-weld-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-mask&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~0-628-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=50415K67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2250415K67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-splitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-15795-818-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solid-truss-head-rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brewers%27-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solid-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27549 pages (at 45 pages/min), scraped 600 items (at 1 items/min)
2026-01-04 08:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~0-628-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/for-use-with~cleanout-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/an-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-15795-818-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solid-truss-head-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968320%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-clamp-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452220%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dummy-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solid-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=development-boards/electrical-connection~usb-c&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/open-end-wrenches/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A648&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A648%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dumore-die-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979761309988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=development%20boards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979761309988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spade-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/open-end-wrenches/material~aluminum/
2026-01-04 08:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bubble-wrap-packaging/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-16995-10-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1387N302&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221387N302%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pg-thread-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spanner-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spade-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bubble-wrap-packaging&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fitting-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16995-10-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pg-thread-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spanner-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duo-cone-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27601 pages (at 52 pages/min), scraped 602 items (at 2 items/min)
2026-01-04 08:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-grinder-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~calcium-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~27-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/material~plastic-1/material~acetal/material~delrin-acetal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-16996-39-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bullet-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~calcium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~25millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-cones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~27millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/material~plastic/material~delrin-acetal-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-cutting-circular-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16996-39-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~25millimeters/
2026-01-04 08:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bullet-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~27millimeters/
2026-01-04 08:38:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plastic-sheets/material~plastic/material~delrin-acetal-plastic//
2026-01-04 08:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4657N34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224657N34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-16996-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spill-control-barrels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-16997-22-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bun-rack-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval-number~tc-84a-0013/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spill-control-pallets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-masks/niosh-approval-number~tc-84a-1350/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/shape~cap-and-plug/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27642 pages (at 41 pages/min), scraped 603 items (at 1 items/min)
2026-01-04 08:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16996-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spill-control-barrels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16997-22-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bun-rack-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spill-control-pallets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-masks/niosh-approval~tc-84a-0013&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-masks/niosh-approval~tc-84a-1350&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/shape~cap-plug&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spindle-nut-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-trash-bins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dust-masks/niosh-approval~tc-84a-1350/
2026-01-04 08:39:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dust-masks/niosh-approval~tc-84a-0013/
2026-01-04 08:39:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose-fittings/connection-style~barbed/shape~cap-plug/
2026-01-04 08:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bus-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushing-drivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~e20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/military-specification~ms20426ad5-6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spindle-nut-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bussmann-type-atm-fuses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-flowmeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-trash-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~6millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bus-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushing-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~e20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~6millimeters/
2026-01-04 08:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27686 pages (at 44 pages/min), scraped 603 items (at 0 items/min)
2026-01-04 08:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-mop-handles/handle-material~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-20426-ad5-6-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bussmann-type-atm-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~e20/
2026-01-04 08:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/military-specification~ms20470ad3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/military-specification~ms20470ad3-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-916-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyolefin-balls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-mop-handles/handle-material~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/split-head-hammers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/fitting-connection~barbed-2/material~bronze-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-plugs/material~polypropylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-20470-ad3-4-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dust-mop-handles/handle-material~wood/
2026-01-04 08:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~ip25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-20470-ad3-5-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/butcher-block-tops/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050743%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5535898822009&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dust%20plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5535898822009%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyolefin-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-21042-06-locknuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-garbage-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~ip25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-21043-5-locknuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/voltage~18v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27728 pages (at 42 pages/min), scraped 603 items (at 0 items/min)
2026-01-04 08:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~no-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=butcher-block-tops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dustless-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~ip25/
2026-01-04 08:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/thread-type~un-unf-sae-45&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-21042-06-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000110913%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-21043-5-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/voltage~18v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~no-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprayer-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-insulation-jacketing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connection-type~crimp-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5598907428381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5598907428381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552926%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/wrenches/size~no-40/
2026-01-04 08:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-reel-bumper-stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linear-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-adjusters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-21045-8-locknuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprayer-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24667-2-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24671-10-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hospital-grade-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-linear-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/square-drive-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-adjusters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-21045-8-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27774 pages (at 46 pages/min), scraped 603 items (at 0 items/min)
2026-01-04 08:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=144mxl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=513557860808&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B513557860808%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000160169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24667-2-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24671-10-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=18-8-stainless-steel-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24671-52-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24693-c17-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=direct-drive-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24693-c24-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=housekeeping-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprinkler-head-escutcheons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24671-52-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c17-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=240xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eccentric-tube-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprinkler-head-escutcheons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hubs/connects-to~electrical-box&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c24-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edge-finders/manufacturer~starrett-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=economical-garolite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edge-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9925098387032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hubs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9925098387032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003411261%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-24693-c34-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27825 pages (at 51 pages/min), scraped 603 items (at 0 items/min)
2026-01-04 08:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wyes/pipe-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cam-levers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7864T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227864T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=300xl-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984228142725&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wyes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984228142725%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edge-finders/manufacturer~starrett&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lapping-sticks/shape~square/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-neck-bolt-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c34-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/edge-finders/manufacturer~starrett/
2026-01-04 08:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-safe-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=390h-timing-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms27183-44/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-lapping-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-neck-bolt-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hvac-thermostats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dog-snaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/color~off-white-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-27183-44-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dome-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms35207-267/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edging/profile-shape~flat/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27873 pages (at 48 pages/min), scraped 604 items (at 1 items/min)
2026-01-04 08:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/color~off-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/material~plastic-1/material~ptfe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-closers-and-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35207-267-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4-pin-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edging/profile~flat&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plastic-sheets/color~off-white/
2026-01-04 08:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-reservoirs/bowl-material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=yo-yo-harnesses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=430-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6929397060184&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=edging&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6929397060184%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000006149765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/material~plastic/material~ptfe-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-35338-136-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carbon-black/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-reservoirs/bowl-material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/material~plastic-1/material~acrylic-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plastic-sheets/material~plastic/material~ptfe-plastic/
2026-01-04 08:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standard-magnetic-hooks-and-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=yor-lok-tube-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hydraulic-reservoirs/bowl-material~plastic/
2026-01-04 08:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastic%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512710%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elastic-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbon-black&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-pipe-stub-ends/pipe-schedule~40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35338-136-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elastic-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-magnetic-hooks-and-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27921 pages (at 48 pages/min), scraped 604 items (at 0 items/min)
2026-01-04 08:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-seal-extrusions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-anodes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/staples-for-staplers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-wall-stainless-steel-pipe-stub-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/performance~weather-resistant-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-support-stays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51023-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-galvanized-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cart-king-casters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=staples-for-staplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-padlocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/performance-properties~weather-resistant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51023-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-22/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbow-sweeps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cart-king-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydronic-zone-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plastic-sheets/performance-properties~weather-resistant/
2026-01-04 08:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51575-22-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-lip-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 27967 pages (at 46 pages/min), scraped 604 items (at 0 items/min)
2026-01-04 08:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51575-23-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=i-beam-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51575-3-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-tie-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/pipe-material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-tie-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ibc-tote-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stationary-spray-nozzles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casters/application~towing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/for-use-with~alcohol-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ibuprofen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/thickness~1-2-1/thickness~0-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casters/system-of-measurement~metric/mount-type~stem/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drafting-chairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastic%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001456202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001469213%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/pneumatic-casters-with-rubber-wheels/performance-properties~for-towing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/for-use-with~alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/system-of-measurement~metric/mount-type~stem&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222197482921188%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28016 pages (at 49 pages/min), scraped 604 items (at 0 items/min)
2026-01-04 08:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acme-square-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/for-use-with~alcohol/
2026-01-04 08:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ice-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acme-thread-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=22925T812&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2222925T812%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/thickness~4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3655N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223655N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=id-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51957-26-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51957-31-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastic%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001463117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~17-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627802%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caulk-smoothing-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51957-26-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001607801%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=draw-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51957-31-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastic%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001463117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caulk-smoothing-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28067 pages (at 51 pages/min), scraped 606 items (at 2 items/min)
2026-01-04 08:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastic%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001463117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-toe-shoes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-socket-weld-pipe-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/fitting-connection~claw-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cee-7%252f7-power-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51958-122-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acrylic-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001629723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steering-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002363819%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastic%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001463117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/for-use-with~sodium-hypochlorite-bleach&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-toe-shoes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ms-51958-65-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cellular-phone-boosters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=elbows&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984462%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51958-122-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/military-specification~ms20822-16k/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7436T211&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227436T211%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steering-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/flute-type~spiral-2/flute-type~parabolic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51958-65-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cellular-phone-boosters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/pipe-material~copper-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=zip%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/military-specifications-met~ms20822-16k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28116 pages (at 49 pages/min), scraped 607 items (at 1 items/min)
2026-01-04 08:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ceramic-blade-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/bit-style~parabolic-spiral-flute&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=elbows&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002197625%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/material~stainless-steel/
2026-01-04 08:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/military-specifications-met~ms20822-16k/
2026-01-04 08:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inconel-hx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937705%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/certification-stickers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-threaded-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-blade-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/finish~titanium-nitride-tin-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/pipe-size~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/pipe-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001535325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=certification-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/for-use-on~nickel-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980774817151&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=elbows&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980774817151%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047728%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/military-specification~ms20822-2j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elbows/military-specification~ms20822-4-4k/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:49:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/material~cobalt-steel/flute-direction~left-hand&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=45605K525&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2245605K525%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~80&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~alcohol-based-solvents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/specifications-met~ms20822-2j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28165 pages (at 49 pages/min), scraped 608 items (at 1 items/min)
2026-01-04 08:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain-come-alongs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows/specifications-met~ms20822-4-4k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-water-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/specifications-met~ms20822-2j/
2026-01-04 08:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/number-of-pieces~80&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:50:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/elbows/specifications-met~ms20822-4-4k/
2026-01-04 08:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3891N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223891N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straight-and-right-angle-hydraulic-drivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straight-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/prong-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-come-alongs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968013%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/specifications-met~federal-specification/specifications-met~fed-spec-a-a-55592/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straight-and-right-angle-hydraulic-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straight-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20165A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220165A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=prong-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~5-8-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-size~m2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-a-a-55592b-continuous-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adapters/thread-size~5-8-11/
2026-01-04 08:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strapping-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chalk/for-use-on~chalkboard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20165A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220165A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28212 pages (at 47 pages/min), scraped 609 items (at 1 items/min)
2026-01-04 08:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mufflers/thread-type~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/thread-type~npt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/tube-od~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stringer-bead-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chamfer-router-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strapping-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9972745186524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9972745186524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002218289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chalkboard-chalk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20165A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220165A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mufflers/thread-type~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastics/thickness~1-2-1/thickness~0-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4322K851&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224322K851%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stringer-bead-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=482801527654&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B482801527654%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=778212328374&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B778212328374%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001456202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001469213%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cheesecloth-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/structural-pipe-crosses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=20165A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2220165A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=482801527654&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B482801527654%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mufflers/thread-type~metric&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/prototype-circuit-boards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-gearmotors/ul-file-number~e199928&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastics/thickness~6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chemical-weld/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mushroom-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cheesecloth-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=structural-pipe-crosses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005015917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=778212328374&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plastics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B778212328374%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464484%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28258 pages (at 46 pages/min), scraped 610 items (at 1 items/min)
2026-01-04 08:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plate-dogs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-motors/mounting-position~vertical&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=prototype-circuit-boards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2656T65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222656T65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemical-weld&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mushroom-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ptfe-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4889881527474&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4889881527474%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090674%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005015917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/submersible-circulating-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electric-powered-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/nut-type~socket/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sun-shades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ptfe-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite/manufacturer-model-number~5240&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005015917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plates/material~aluminum-2/material~6101-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=submersible-circulating-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plates/material~aluminum-2/material~a356-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002242151%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089900%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512093%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/nut-type~socket-head&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chuck-keys/chuck-key-number~k4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sun-shades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1676N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221676N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3535199831245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electric%20gearmotors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3535199831245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005015917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chuck-keys/chuck-key-number~k7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite/manufacturer-model-number~ea-9490&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/inserts/nut-type~socket-head/
2026-01-04 08:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28307 pages (at 49 pages/min), scraped 611 items (at 1 items/min)
2026-01-04 08:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nano-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ptfe-paste/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002242151%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096551%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/boring-rings-for-machinable-lathe-chuck-jaws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-keys/key-number~k4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/surface-finish-comparators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-keys/key-number~k7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chuck-keys/key-number~k4/
2026-01-04 08:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nano-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chuck-keys/key-number~k7/
2026-01-04 08:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lathe-chuck-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chucks/boring-rings-for-machinable-lathe-chuck-jaws-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-finish-comparators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~loctite/manufacturer-model-number~ea-3472/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-wool/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circle-cotters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chucks/boring-rings-for-machinable-lathe-chuck-jaws-5/
2026-01-04 08:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chucks/lathe-chuck-wrenches-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/circuit-board-trays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plier-jaw-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pull-handles/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~loctite-/manufacturer-model-number~ea-3472&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/chucks/lathe-chuck-wrenches-6/
2026-01-04 08:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-preparation-steel-wool&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circle-cotters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28351 pages (at 44 pages/min), scraped 612 items (at 1 items/min)
2026-01-04 08:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swell-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inside-hole-calipers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circuit-board-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pull-handles/mount-type~snap-in/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-handles/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pull-handles/mount-type~strap-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inside-hole-micrometers/manufacturer-model-number~146-233&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swell-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pull-handles/material~aluminum/
2026-01-04 08:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4985731609619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inside%20hole%20micrometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4985731609619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005389968%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plug-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-handles/mount-type~snap-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352c-06-12-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-handles/mount-type~strap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/american-wire-gauge-awg~28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cylinders/rod-end-type~internally-threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plug-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1393964000724&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1393964000724%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010861%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1393964000724&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1393964000724%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010750%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4216247920660&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20cylinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4216247920660%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001922311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pull-to-reset-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/hvac-filter-trade-size~24-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352c-06-12-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6021N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226021N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulley-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352c-6-12-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=instant-bond-adhesive-gel-for-manual-dispensing-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28398 pages (at 47 pages/min), scraped 612 items (at 0 items/min)
2026-01-04 08:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005043274%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352c-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-to-reset-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~16-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulley-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352c-6-12-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-loaded-pulleys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-050&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562847%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352c-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulated-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~18-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001495879%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K38&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K38%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~2-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-090&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/constant-tension-v-belt-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1883T4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221883T4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cleaners/for-use-on~coolant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/fitting-connection~claw-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/constant-tension-v-belt-pulleys/
2026-01-04 08:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7088K214&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227088K214%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-109&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/size~2-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cleanouts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K718&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K718%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28445 pages (at 47 pages/min), scraped 616 items (at 4 items/min)
2026-01-04 08:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505249%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/belt-trade-size~spb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~coolant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~20-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/connection-style~claw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/t-handles/size~2-5-mm/
2026-01-04 08:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9685T2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229685T2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929866%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001560908%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plugs/connection-style~claw/
2026-01-04 08:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/drive-size~t27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas-620-c8-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleanouts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~20-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/for-belt-trade-size~spb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/for-belt-trade-size~spb/
2026-01-04 08:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/fitting-connection~quick-disconnect/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clock-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~chutes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/size~t27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/idler-pulleys/belt-type~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-620-c8-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:56:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/t-handles/size~t27/
2026-01-04 08:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/fitting-connection~quick-disconnect-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clock-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-awg~28-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/table-leg-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/round-belt-idler-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plugs/fitting-connection~quick-disconnect-1/
2026-01-04 08:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pump-cans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28493 pages (at 48 pages/min), scraped 619 items (at 3 items/min)
2026-01-04 08:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clr-removers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pulleys/round-belt-idler-pulleys/
2026-01-04 08:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9634T105&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229634T105%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=table-leg-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pump-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clr-removers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/performance-properties~high-voltage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-designation~ofnr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~8-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/performance~interference-shielding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/insulation/performance-properties~high-voltage/
2026-01-04 08:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tack-rags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015640%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002117475%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power~1-1-3-hp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5499N24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225499N24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1289T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221289T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-use-with~ethyl-alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~9-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/cable-designation~soow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tack-rags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964443%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28545 pages (at 52 pages/min), scraped 622 items (at 3 items/min)
2026-01-04 08:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/power~1-1-3-hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/neck-gaiters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/power~1-3-hp-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-hanging-welders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8239K239&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228239K239%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1075T152&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221075T152%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/needle-applicators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000006126695%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7081K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227081K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=neck-gaiters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/power~1-3-hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-testers/display-type~light-indicator&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=needle-applicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pumps/power~1-3-hp/
2026-01-04 08:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tandem-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-use-with~plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/flammability-rating~ul-2556-ft4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7236263124998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation%20testers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7236263124998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001933403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/flammability-rating~ul-2556-vw-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537K132&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537K132%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 08:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/needle-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380183%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tank-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380810%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=interchangeable-core-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tandem-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:08 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/for-use-with~plugs&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 08:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coiled-spring-pin-insert-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9700T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229700T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28593 pages (at 48 pages/min), scraped 625 items (at 3 items/min)
2026-01-04 08:59:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/number-of-wires~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cold-saw-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=needle-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coiled-spring-pin-insert-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=interfaces/electrical-connection~ix-industrial&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/material~magnesium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531044%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9924373003142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=interfaces&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9924373003142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=allen-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7741K13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227741K13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cold-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~1-3-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5704N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225704N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alloy-20-stainless-steel-flat-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plugs/material~steel/
2026-01-04 08:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 08:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/specifications-met~nec-article-800&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~1-1-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collets/collet-size~1-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~1-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~13-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28640 pages (at 47 pages/min), scraped 628 items (at 3 items/min)
2026-01-04 09:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap%252fdrill-combination-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~1-3-8/
2026-01-04 09:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75985K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275985K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inverted-tooth-chain-and-links/inverted-tooth-chain-trade-number~sc304&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cable/wire-construction~stranded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~1-1-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/size~1-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~13-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2977408974097&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inverted%20tooth%20chain%20and%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2977408974097%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005312551%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/collets/size~1-1-32/
2026-01-04 09:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/collets/size~1-3-8/
2026-01-04 09:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~15-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~13-64/
2026-01-04 09:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/anode-type~rod/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/thread-type~bspp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~15-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/thread-type~pg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~15-16/
2026-01-04 09:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ionizing-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000037076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~15-2mm/
2026-01-04 09:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tapping-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121708%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/type~rod&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/collision-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-connector-boots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28690 pages (at 50 pages/min), scraped 629 items (at 1 items/min)
2026-01-04 09:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plugs/type~rod/
2026-01-04 09:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nema-l18-30-receptacles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/nema-type~l19-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nema-l19-20-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-type~npt/pipe-size~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tapping-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collision-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nema-l22-20-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tea-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bronze-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7817035884102&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7817035884102%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l19-20-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l19-20-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l18-30-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l22-20-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tea-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/receptacles/nema-type~l22-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-garbage-and-recycling-cans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cord-circuit-interrupter-converters/electrical-protection-type~elci&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/purgers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~8mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cord-circuit-interrupter-converters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5620190349820&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cord%20circuit%20interrupter%20converters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5620190349820%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005320250%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28733 pages (at 43 pages/min), scraped 629 items (at 0 items/min)
2026-01-04 09:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nema-l6-20-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/punches/for-hole-diameter~8mm/
2026-01-04 09:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l22-20-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cord-reels/extension-cord-length~45-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=purgers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plungers/fastener-head-type~l-handle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/handle-locking-type~twist-to-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/push-button-enclosures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9834004401048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cord%20reels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9834004401048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000046744%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l6-20-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/telescoping-poles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-k-high-vacuum-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/thread-size~5-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4804K13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224804K13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plungers/thread-size~5-8-11-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/handle-type~l-handle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-button-enclosures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nema-outlets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001938773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telescoping-poles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~no-36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/thread-size~5-8-11-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/thread-size~m14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/cable-designation~sjeow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-outlets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28782 pages (at 49 pages/min), scraped 630 items (at 1 items/min)
2026-01-04 09:03:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/plungers/thread-size~5-8-11-1/
2026-01-04 09:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-chart-recorders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361530%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~no-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-oxide-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temperature-indicating-stickers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-oxide-sanding-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7248K25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227248K25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/combination-wrenches/size~no-36/
2026-01-04 09:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/commutator-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-chart-recorders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/temporary-door-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-indicating-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=commutator-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/color~amber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/color~fluorescent-pink&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temporary-door-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/terminal-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548139%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-rods/material~aluminum-2/material~5005-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002194654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7010901550041&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7010901550041%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air%252fgas-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/neoprene-rubber-rod-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9906T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229906T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28831 pages (at 49 pages/min), scraped 631 items (at 1 items/min)
2026-01-04 09:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8208K103&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228208K103%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=terminal-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tesla-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/push-to-close-door-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=neoprene-rubber-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jacobs-chuck-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-sheets/material~aluminum-2/material~1235-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/push-to-connect-beverage-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-glue-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/neoprene-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/test-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tesla-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bin-boxes/space-saving-features~nestable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nestable-bins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-close-door-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/material~aluminum/material~1235-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-connect-beverage-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=neoprene-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=test-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/finish~phosphate-coated/color~black-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-cords/nema-type~6-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nestable-bin-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/netting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nestable-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/theater-stage-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28875 pages (at 44 pages/min), scraped 633 items (at 2 items/min)
2026-01-04 09:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001555313%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/push-to-connect-tube-fittings-for-shore-d-hardness-nylon-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermal-imaging-cameras/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nfpa-cylinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001555313%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/finish~phosphate-coated/color~black-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-cords/nema-style~6-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=netting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=theater-stage-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-connect-tube-fittings-for-shore-d-hardness-nylon-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/electrical-cords/nema-style~6-20/
2026-01-04 09:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-shears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nfpa-cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-receptacles/for-wire-gauge~21&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/putty/for-use-on~rubber-2/for-use-on~epdm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/putty/for-use-on~galvanized-iron/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=541000574830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20receptacles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B541000574830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001997419%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/computer-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-regulators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~3-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermostat-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~9-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-sheets/thickness~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~epdm-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28921 pages (at 46 pages/min), scraped 633 items (at 0 items/min)
2026-01-04 09:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~galvanized-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~3-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20sheets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001468702%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermostat-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/putty/for-use-on~epdm-rubber/
2026-01-04 09:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermostat-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pocket-hole-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/putty/for-use-on~porcelain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/concrete-removers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-air-actuated-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermostat-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wire/csa-file-number~061256-0-000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=concrete-removers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~porcelain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132793%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-air-actuated-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulated-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6513T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226513T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wrap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jam%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071717%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 28972 pages (at 51 pages/min), scraped 634 items (at 1 items/min)
2026-01-04 09:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=janitorial-sinks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-butterfly-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-duct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/poles/material~hard-fiber-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrically-actuated-water-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/for-use-with~cyclobutane/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pole-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electronics-enclosures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/throatless-shears/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=poles/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-butterfly-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=poles/material~hard-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992979646156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=poles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992979646156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~cyclobutane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/poles/material~hard-fiber/
2026-01-04 09:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=emergency-stop-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=throatless-shears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967471%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/for-use-with~lubricant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/continuity-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/side-load-threaded-rod-mount-loop-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=enclosed-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-power-cable-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A329&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A329%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=enclosure-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/contour-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%222229037755462%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jars/capacity~205-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29018 pages (at 46 pages/min), scraped 635 items (at 1 items/min)
2026-01-04 09:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=continuity-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilesetters-hammers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3131T52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223131T52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-van-stone-flanges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-power-cable-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nipples/for-use-with~lubricants/
2026-01-04 09:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contour-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jars/capacity-weight-~205-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/for-use-with~refrigerant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=encoder-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/for-use-with~silicon-tetrafluoride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tilesetters%27-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/jars/capacity-weight-~205-ml/
2026-01-04 09:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tilt-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-pipe-van-stone-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polishing-media&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pvc-square-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~refrigerant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~silicon-tetrafluoride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=poly-v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963050%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-aerators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/for-use-on~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pants/application~electrical-protection-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polycarbonate-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29065 pages (at 47 pages/min), scraped 636 items (at 1 items/min)
2026-01-04 09:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-square-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A717&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A717%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tire-bumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-fluid-deodorizers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963050%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-aerators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-protection-pants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jewelers-slotting-saw-arbors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-fluid-deodorizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polycarbonate-extrusions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anti-static-vacuum-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963050%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tire-bumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polycarbonate-rectangular-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jewelers%27-slotting-saw-arbors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=argon-pressure-regulating-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toggle-switch-boots/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-receptacles/for-wire-gauge~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963050%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squares/material~petg/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester/backing-type~adhesive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=541000574830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20receptacles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B541000574830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001999994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pyrell/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29113 pages (at 48 pages/min), scraped 637 items (at 1 items/min)
2026-01-04 09:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arm-sleeves/environment~clean-room&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toilet-partition-latches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nitinol-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toggle-switch-boots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9878768268149&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=polyester&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9878768268149%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester-(petg)-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2106002948453&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=arm%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2106002948453%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002256952%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quad-receptacles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8689K63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228689K63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pyrell&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-partition-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=541000574830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20receptacles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B541000574830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001999994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitinol-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5424N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225424N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-sockets/connector-shell-size~20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/toilet-tank-flush-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coolant-hose/material~buna-n/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quarter-turn-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8358313672822&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8358313672822%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001566998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=john-perry-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5424N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225424N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6134T47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226134T47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=541000574830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20receptacles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B541000574830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001999994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-sockets/number-of-circuits~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toilet-tank-flush-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrile-coolant-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=authorized-personnel-only-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quarter-turn-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8358313672822&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20sockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8358313672822%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548635%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5424N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225424N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29165 pages (at 52 pages/min), scraped 638 items (at 1 items/min)
2026-01-04 09:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=joints/fitting-type~outlet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6134T47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226134T47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=541000574830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20receptacles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B541000574830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001999994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8302N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228302N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992188250120&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=joints&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992188250120%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002464580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/queue-barriers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tool-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5424N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225424N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4565T311&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224565T311%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester-string&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6134T47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226134T47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~1-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=queue-barriers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=axles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000053987%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=axles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=equipment-coolers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:11:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6134T47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226134T47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1346K523&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221346K523%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=junction-boxes/environment~sanitary&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nlgi-no-3-grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/no-1xsp-clipper-belt-lacing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/corrugated-paper-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5861588236444&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=junction%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5861588236444%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29214 pages (at 49 pages/min), scraped 641 items (at 3 items/min)
2026-01-04 09:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ergonomic-force-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kalrez-o-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=evacuation-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-1xsp-clipper-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/butane-torches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=corrugated-paper-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wire/american-wire-gauge-awg~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-limiting-extension-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kevlar%252fnylon-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/no-spill-jars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torches/butane-torches-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/craftsman-compatible-chain-saw-chains/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-limiting-extension-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6176551385129&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6176551385129%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223706732622709%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-sheet-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-spill-jars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75195A27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275195A27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=craftsman-compatible-chain-saw-chains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-drive-wall-anchors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~10-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29261 pages (at 47 pages/min), scraped 641 items (at 0 items/min)
2026-01-04 09:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/touch-screen-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-mount-doors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000023808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-release-shackles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonfusible-disconnect-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-drive-wall-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=touch-screen-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extended-point-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-mount-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wire/wire-construction~stranded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-release-shackles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonfusible-disconnect-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crosby-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyolefin-pin-terminals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bands/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/material~plastic-1/material~polypropylene/pipe-schedule~80/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:13:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=key-to-reset-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crosby-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyboard-wrist-rests&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bands/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-(schedule-80)-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyboards-and-mouse&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29311 pages (at 50 pages/min), scraped 642 items (at 1 items/min)
2026-01-04 09:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barbed-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-wire-terminal-splitters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bands/material~steel/
2026-01-04 09:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1001eh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-banding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirator-filters/respirator-filter-rating~r95/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~50-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polypropylene-extrusions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001623806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4072418438324&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrical%20wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4072418438324%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rack-stickers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~1001eh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extensions/electrical-connection~usb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=r95-respirator-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonmetallic-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1069n/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:14:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~1001eh/
2026-01-04 09:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9996540530177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extensions&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9996540530177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cryogenic-containers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1092v/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/triacetate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rack-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/racks/mobility~stationary/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29357 pages (at 46 pages/min), scraped 642 items (at 0 items/min)
2026-01-04 09:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-size~aaa&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmetallic-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~1069n&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/beams/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cryogenic-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~1092v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038733%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~1069n/
2026-01-04 09:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=triacetate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=racks/stationary-or-mobile~stationary&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~1092v/
2026-01-04 09:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/radial-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beams/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrodes/for-manufacturer~miller&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/racks/stationary-or-mobile~stationary/
2026-01-04 09:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~b74/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~ar1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrodes/for-manufacturer~thermal-dynamics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/beams/material~stainless-steel/
2026-01-04 09:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/radiators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994383438024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrodes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994383438024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123964%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/shaft-diameter~1-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~bes5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=radial-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994383438024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=electrodes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994383438024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106467%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~b74&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002270122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nonwoven-abrasive-rolls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=65935A25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2265935A25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/ball-bearing-profile~standard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=radiators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~ar1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~b74/
2026-01-04 09:16:08 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002270122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/shaft-diameter~1-11-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29405 pages (at 48 pages/min), scraped 642 items (at 0 items/min)
2026-01-04 09:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~bes5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002849580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~ar1/
2026-01-04 09:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~in35/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electronic-grade-copper-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~bes5/
2026-01-04 09:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonwoven-abrasive-rolls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rail-slides/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/truck-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electronic-height-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters-for-paper-rolls/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polysulfone-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~m10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~in35&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rail-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=truck-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fogging-nozzles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters-for-paper-rolls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rails/component~spacer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~2205&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~in35/
2026-01-04 09:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~o1007lf/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/voltage~277v-ac-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113910%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~m10/
2026-01-04 09:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing-restrictor-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tug-of-war-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/fogging-nozzles-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rails/component~spacer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29448 pages (at 43 pages/min), scraped 643 items (at 1 items/min)
2026-01-04 09:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nozzles/for-use-with~steel-shot/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9830859981210&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9830859981210%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%22391409895749%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~o1007lf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948522430991&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948522430991%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002246720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/voltage~277v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turbomolecular-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-restrictor-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tug-of-war-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4759T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224759T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5897K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225897K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fans/voltage~277v-ac/
2026-01-04 09:17:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~o1007lf/
2026-01-04 09:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/for-use-with~steel-shot&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pop-rivets/mandrel-material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turbomolecular-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rat-tail-files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/definite-purpose-contactors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9830859981210&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9830859981210%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nozzles/spray-pattern~flat/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pop-rivets/material~110-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pop-rivets/mandrel-material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ratchet-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pop%20rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511329%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rat-tail-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=definite-purpose-contactors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ratchet-drivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/desiccant-breathers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/spray-pattern~flat&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pop-rivets/mandrel-material~steel/
2026-01-04 09:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90217A610&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290217A610%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29493 pages (at 45 pages/min), scraped 645 items (at 2 items/min)
2026-01-04 09:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9830859981210&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9830859981210%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchet-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ratchets/component~pawl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=emi-rfi-shielding-foil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/twist-lock-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=desiccant-breathers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~09278&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thicknesses-included~0-15-mm-to-0-60-mm-0-05-mm-increments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1043j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400941%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchets/component~pawl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:33 [scrapy.core.downloader.handlers.http11] (PID: 126) WARNING: Got data loss in https://www.mcmaster.com/products/ratchet-drivers/. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests
2026-01-04 09:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ratchet-drivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=portable-air-coolers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-industry-number~54n14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twist-lock-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A235&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A235%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988466368360&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988466368360%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002253989%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/feeler-gauge-thicknesses-included~0-15-mm-to-0-60-mm-0-05-mm-increments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/mount-type~press-fit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6283K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226283K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/tig-torch-nozzles/industry-number~54n14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/feeler-gauges/feeler-gauge-thicknesses-included~0-15-mm-to-0-60-mm-0-05-mm-increments/
2026-01-04 09:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/two-part-silicone-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1092/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8031429930803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8031429930803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchet-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/nozzles/tig-torch-nozzles/industry-number~54n14/
2026-01-04 09:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=portable-demagnetizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~r156&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/diameter-tape-measures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29539 pages (at 46 pages/min), scraped 648 items (at 3 items/min)
2026-01-04 09:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112637%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~10r23&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-part-silicone-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~1092&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/material~carbide/shank-type~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=female-standoffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400694%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~1092/
2026-01-04 09:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diameter-tape-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nsf%252fansi-standard-sinks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~11-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nsf%252fansi-standard-thermometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/carbide-round-shank-reamers-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-carts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=portable-walls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reamers/carbide-round-shank-reamers-10/
2026-01-04 09:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/u-cup-installation-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nurdles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~111-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000135375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~11-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/die-grinder-collets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000082390%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-housing-id~11-6mm/
2026-01-04 09:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/system-of-measurement~inch/reamer-operation~hand/reamer-type~for-taper-pin-holes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-cup-installation-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/fitting-connection~quick-clamp-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nurdles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29589 pages (at 50 pages/min), scraped 648 items (at 0 items/min)
2026-01-04 09:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nutdriver-screwdrivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-grinder-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/system-of-measurement~metric/material~high-speed-steel/shank-type~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/inch-size-hand-reamers-for-taper-pin-holes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2-048&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~203&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nutdriver-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reamers/inch-size-hand-reamers-for-taper-pin-holes/
2026-01-04 09:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=encoders/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fh-632-10-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140561%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/metric-size-high-speed-steel-round-shank-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4458676663226&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=encoders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4458676663226%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reamers/metric-size-high-speed-steel-round-shank-reamers/
2026-01-04 09:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=positioning-slides/stroke-length~400-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1189A411&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221189A411%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075781%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/digital-pressure-scales/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fh632-10-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/digital-push-button-counters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5136333732234&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=positioning%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5136333732234%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167757%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fhs-032-10-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4458676663226&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=encoders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4458676663226%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ultraviolet-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6734K816&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226734K816%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-0405/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-pressure-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-push-button-counters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29637 pages (at 48 pages/min), scraped 649 items (at 1 items/min)
2026-01-04 09:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~3-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4458676663226&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=encoders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4458676663226%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fhs032-10-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-repairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultraviolet-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0405&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131201%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/underwater-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000016600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4458676663226&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=encoders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4458676663226%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~40-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~27676&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~2782&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:43 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000016600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0405&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/union-check-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/posts/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401397%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=underwater-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3096&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-cutters/for-use-on~hard-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401355%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~60-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~40mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400550%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5499300003000&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5499300003000%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=union-check-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=posts/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-housing-id~40mm/
2026-01-04 09:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-0725/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29683 pages (at 46 pages/min), scraped 650 items (at 1 items/min)
2026-01-04 09:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3738A1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223738A1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/posts/material~stainless-steel/
2026-01-04 09:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~60mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/for-housing-id~78-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=potentiometers/environment~submersible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/for-use-on~carbon-fiber-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-housing-id~60mm/
2026-01-04 09:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-0820/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0725&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7458750031228&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=potentiometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7458750031228%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=potentiometers/ul-file-number~e68568&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=potting-compounds/for-use-on~copper-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~78mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7458750031228&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=potentiometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7458750031228%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005408241%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8322972566281&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=potting%20compounds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8322972566281%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-use-on~acrylic-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-housing-id~78mm/
2026-01-04 09:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0820&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0725&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/display-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7506T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227506T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-0875/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fillers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-use-on~ovens-and-furnaces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:23:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0820&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=display-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-use-on~stone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/disposable-gloves/color~brown-woodgrain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29733 pages (at 50 pages/min), scraped 652 items (at 2 items/min)
2026-01-04 09:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fillers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930280%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0875&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~14-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pourable-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fillers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930162%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000045746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filter-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/nut-type~locknut/thread-size~m33/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=powders/chemical~pumice&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1050/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disposable-gloves/color~brown-woodgrain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000045746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0875&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1065/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~14mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3445430086859&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=powders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3445430086859%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323570%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/distance-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3479746684510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3479746684510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002195101%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-shaft-diameter~14mm/
2026-01-04 09:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~m33&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-024&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1050&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-028&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1065&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334820%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001731369%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=distance-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/nut-type~locknut/thread-size~m90/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001715176%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334820%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~m33&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~a473&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8832A41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228832A41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:10 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1050&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29781 pages (at 48 pages/min), scraped 652 items (at 0 items/min)
2026-01-04 09:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8832A45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228832A45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1065&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002399093%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/for-use-with~odors-from-organic-vapors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1253/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fine-filtration-vacuums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/finishing-plugs/material~polyethylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cords/connects-to~battery&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~ae2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-cords/iec-connector-type~c19/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/creepers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4895046738192&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=power%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4895046738192%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003418117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400438%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1253&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finishing-plugs/material~polyethylene-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=69735K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2269735K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001725583%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-shaft-diameter~5/
2026-01-04 09:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cords/iec-style~c19&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000077421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:24:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/finishing-plugs/material~polyethylene-plastic/
2026-01-04 09:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dollies/creepers-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-1285/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/shaft-diameter~78-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/power-cords/iec-style~c19/
2026-01-04 09:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~bes4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-petroleum-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4236684941730&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4236684941730%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%227085352368832%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29829 pages (at 48 pages/min), scraped 655 items (at 3 items/min)
2026-01-04 09:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-samplers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2661T85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222661T85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-1285&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-shaft-diameter~78mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-bell-buttons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~1-8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-resistant-clothing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-petroleum-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:25:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/for-shaft-diameter~78mm/
2026-01-04 09:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001746579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-samplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~bes4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~10-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-bell-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8471N69&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228471N69%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-tables/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~bes4/
2026-01-04 09:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~1-12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~10-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~10mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-work-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~4-125/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001711330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-cords/voltage~2000v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001723883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/end-mills/mill-diameter~10mm/
2026-01-04 09:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29878 pages (at 49 pages/min), scraped 657 items (at 2 items/min)
2026-01-04 09:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~5-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8940A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228940A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4895046738192&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=power%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4895046738192%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553707%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valve-core-removers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8876A53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228876A53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-work-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496872%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-gates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2962N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222962N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=five-minute-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493072%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8911K373&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228911K373%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8940A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228940A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-core-removers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-interlock-disconnect-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-gates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~eg2r/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/material~6061-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~haw2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/door-mounting-hardware-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/variable-output-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8940A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228940A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512136%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-interlock-disconnect-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc106&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~2-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~eg2r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~haw2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-mounting-hardware-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29924 pages (at 46 pages/min), scraped 660 items (at 3 items/min)
2026-01-04 09:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variable-output-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8940A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228940A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~eg2r/
2026-01-04 09:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~haw2/
2026-01-04 09:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vent-pipe-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~4-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-saddle-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-over-ethernet-injectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/double-sphere-expansion-joints/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanged-electrical-inlets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038829%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/certification~dnv-gl-type-approved&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~2-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vent-pipe-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-saddle-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5598907428381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=power%20supplies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5598907428381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002263134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vertical-file-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452842%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-sphere-expansion-joints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3719N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223719N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A023&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A023%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~9-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 29975 pages (at 51 pages/min), scraped 661 items (at 1 items/min)
2026-01-04 09:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vertical-file-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=end%20mills&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001746002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~r1064e/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~2-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~20-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A023&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A023%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8876A33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228876A33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dowel-pin-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002240260%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002266865%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~r1064e&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/shaft-diameter~25-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flap-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~m160/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A023&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A023%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/key-number~r1064e/
2026-01-04 09:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002265696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vibratory-feeders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/dowel-pin-assortments-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2245/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~sb732&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-supplies/component~cutting-attachment/manufacturer-model-number~ca411-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/dowel-pins/dowel-pin-assortments-5/
2026-01-04 09:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drafting-tape-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m160&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A023&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A023%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401412%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibratory-feeders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~m50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drain-cleaner-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2245&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30020 pages (at 45 pages/min), scraped 662 items (at 1 items/min)
2026-01-04 09:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=victor-ca411-3-oxyacetylene-cutting-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drafting-tape-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011118%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-belt-pulleys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vise-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2480/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drain-cleaner-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~pg-36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drawbar-eyes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-type~diamond/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vise-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2480&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beryllium-copper-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151721%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-2620/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~pg-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epdm-rubber-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-type~diamond&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:54 [scrapy.core.downloader.handlers.http11] (PID: 126) WARNING: Got data loss in https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011118%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true. If you want to process broken responses set the setting DOWNLOAD_FAIL_ON_DATALOSS = False -- This message won't be shown in further requests
2026-01-04 09:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011118%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/manufacturer-equivalent~segal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449099%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394320%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pr44-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2620&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011118%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2245&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-cable-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30069 pages (at 49 pages/min), scraped 662 items (at 0 items/min)
2026-01-04 09:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=97825A110&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2297825A110%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/color~light-amber-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071875%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/manufacturer~segal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449099%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-adjustment-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bit-storage-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bit-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071875%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2620&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:30:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/manufacturer~segal/
2026-01-04 09:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~0-0189/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/color~light-amber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449099%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/color~off-white-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bit-storage-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/epoxies/color~light-amber/
2026-01-04 09:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531540%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flip-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flood-light-bulbs/light-technology~led&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-2-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:30:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449099%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-shaft-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9952148842870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flood%20light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9952148842870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3200/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wasp-traps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30117 pages (at 48 pages/min), scraped 663 items (at 1 items/min)
2026-01-04 09:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-axial-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-torque-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer~gorilla&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-push-on-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wasp-traps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~11-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer~lord&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002263392%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055909%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-demineralizers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244578%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7541A51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227541A51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-tracks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-push-on-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kneeling-mats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055909%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3200&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~11-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=66195A31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2266195A31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-framing-and-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:31:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~11-2-mm/
2026-01-04 09:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-demineralizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-finder-paste/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3415/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-control-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30168 pages (at 51 pages/min), scraped 665 items (at 2 items/min)
2026-01-04 09:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-framing-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-controls/fitting-connection~push-to-connect-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nylon-spacers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~19770&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~15-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-finder-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3415&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~m20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20controls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362219%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/epoxies/manufacturer-model-number~19770/
2026-01-04 09:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000041222%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-hose-reels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3495/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~310a-b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/water-marker-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~15-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000041222%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3415&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20controls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362219%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~15-64/
2026-01-04 09:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3585/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-hose-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3495&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=66195A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2266195A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-marker-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20controls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362219%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/bracket-type~tee&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/bracket-type~triple-90-angle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3585&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~e-120hp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/screw-size~3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562220%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:12 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3495&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30217 pages (at 49 pages/min), scraped 666 items (at 1 items/min)
2026-01-04 09:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/screw-size~m10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-3735/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562062%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086513%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=epoxies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150045%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20controls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362219%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wax-coated-paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086513%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3585&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6430A24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226430A24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/for-screw-size~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/for-screw-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-valves-for-natural-gas/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-ring-screens/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3735&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/brackets/for-screw-size~3-8/
2026-01-04 09:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-nuts/pem-part-number~cls-348-0&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/brackets/for-screw-size~m10/
2026-01-04 09:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146133%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~4-15-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wax-coated-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/mount-type~threaded-stud&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/color~gold/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9946404817603&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=press%20fit%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9946404817603%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/for-use-with~natural-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-ring-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/brackets/material~fiberglass/
2026-01-04 09:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/webbing-mounting-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~4-15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/color~gold&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30263 pages (at 46 pages/min), scraped 667 items (at 1 items/min)
2026-01-04 09:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~4-15-mm/
2026-01-04 09:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxy-packets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flowmeter-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flowmeter-totalizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/screw-size~no-9-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=webbing-mounting-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flowmeters/pipe-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/label-printers/manufacturer~epson-k-sun-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334324%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=453523490803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flowmeters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B453523490803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1556A26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221556A26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epson-label-printers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kraft-paper-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kuritec-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass/material~brass-2/material~360-brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kydex-acrylic-pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:34:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~035&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5551584616364&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brass&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5551584616364%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511057%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~042/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~6-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=equipment-enclosure-curtains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~6-4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047708%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welded-chain-for-lifting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30313 pages (at 50 pages/min), scraped 668 items (at 1 items/min)
2026-01-04 09:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K123&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K123%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-nuts/pem-part-number~s-m10-2zi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~042&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-alloy-385&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~6-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/size~6-4-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9946404817603&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=press%20fit%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9946404817603%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151675%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welded-chain-for-lifting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-alloy-464-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018270%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~6-2-mm/
2026-01-04 09:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l9-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drill-bits/size~6-4-mm/
2026-01-04 09:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~146/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~166/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-tape-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-4580/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018270%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-nuts/thread-size~1-4-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=press-fit-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~178/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~146&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9946404817603&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=press%20fit%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9946404817603%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~166&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-pencils/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4580&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000145549%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30363 pages (at 50 pages/min), scraped 669 items (at 1 items/min)
2026-01-04 09:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018270%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000169805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000130603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~206/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-squares/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K153&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K153%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~178&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K325&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K325%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-pencils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=esd-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000130603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4580&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000093899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018270%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~206&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-strikers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-torch-cutting-guides/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~227/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~247/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/west-system-epoxy-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K336&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K336%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=etching-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086888%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-strikers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-torch-cutting-guides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~227&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~247&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=west-system-epoxy-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K336&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K336%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086888%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-extensions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117464%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30411 pages (at 48 pages/min), scraped 671 items (at 2 items/min)
2026-01-04 09:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000155684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-fall-protection-systems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K336&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K336%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086888%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ladder-gates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~267/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheel-riser-ramps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ethernet-port-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=four-bolt-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauge-snubbers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eva-foam-sheet-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086888%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-5020/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K336&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K336%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~267&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-riser-ramps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~3-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-5110/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000031863%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/for-use-with~gasoline&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5020&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~330/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lagging-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K366&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K366%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30459 pages (at 48 pages/min), scraped 671 items (at 0 items/min)
2026-01-04 09:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014951%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~3-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~50-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5110&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-control-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~330&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014951%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5020&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:38:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~3-5-mm/
2026-01-04 09:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~1000-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000148959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~10000-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065396%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~373/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~50-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000148959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5110&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-fan-guards/blade-diameter~48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~50-mm/
2026-01-04 09:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~1000-psi-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laminated-shims&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~10000-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-fans/blade-diameter~15-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5195649950898&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=exhaust%20fan%20guards&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5195649950898%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-alloy-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-sockets/drive-size~ip15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~373&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001705615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001701973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9102215783954&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=exhaust%20fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9102215783954%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005107605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lamination-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-6500/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30505 pages (at 46 pages/min), scraped 672 items (at 1 items/min)
2026-01-04 09:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-6563/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~40-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drive-sockets/size~ip15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~407/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-7500/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/drive-sockets/size~ip15/
2026-01-04 09:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-6500&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=funnels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-metric-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-6563&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~40-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~1-45-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~407&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143423%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-7500&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pressure%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001744738%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-6500&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~1-65-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~1-45mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K231&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K231%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-8745/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~0-9980/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lanyard-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~459/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/diameter~1-45mm/
2026-01-04 09:40:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~1-65mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30552 pages (at 47 pages/min), scraped 673 items (at 1 items/min)
2026-01-04 09:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/measurement-unit~kilograms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/diameter~1-65mm/
2026-01-04 09:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-8745&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-9980&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/measurement-unit~kilopascals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~459&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanized-iron-pipe-fitting-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-dolly-trucks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exit-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/scale~kilograms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000076670%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-9980&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/scale~kpa&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pressure-gauges/scale~kilograms/
2026-01-04 09:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K453&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K453%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-hand-trucks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/dash-number~910/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-dolly-trucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pressure-gauges/scale~kpa/
2026-01-04 09:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-pallets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~23-0000-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~25-0000-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expanded-metal-mesh&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-hand-trucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~910&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30597 pages (at 45 pages/min), scraped 674 items (at 1 items/min)
2026-01-04 09:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laser-operation-safety-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-pallets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~23-0000-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laser-pointer-styli&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drum-strainers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~25-0000-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/reamer-diameter~8-0000-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121503%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013457%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121503%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~23-0000-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/hardness~durometer-60a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/for-use-with~synthetic-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drum-strainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latch-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=garolite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~8-0000-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/witches-hat-grommets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000133277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/hardness~durometer-70a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/hardness~durometer-60a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/for-use-with~synthetic-lubricants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bulkheads/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000120353%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179281%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=witches%27-hat-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/connects-to~pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30647 pages (at 50 pages/min), scraped 674 items (at 0 items/min)
2026-01-04 09:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/hardness~durometer-70a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duck-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963946302057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bulkheads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963946302057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394432%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expansion-pin-insert-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reciprocating-polishers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bulkheads/material~plastic/
2026-01-04 09:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duck-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primary-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/color~amber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct-booster-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct-liners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rectangular-hand-files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/folding-tables/adjustability~adjustable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7559498251638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7559498251638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548139%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reciprocating-polishers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/recycled-composites/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-booster-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=duct-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rectangular-hand-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbenches/adjustable-height-folding-tables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buried-cable-warning-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/durometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dust-busters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/workbenches/adjustable-height-folding-tables/
2026-01-04 09:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30693 pages (at 46 pages/min), scraped 674 items (at 0 items/min)
2026-01-04 09:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=recycled-composites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~1-100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/for-machining-type~drilling/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/red-metal-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~1-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/cable-designation~sjoow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=durometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107090%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/for-machining-type~milling/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dust-busters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107090%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~1-100&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/electrical-connection~displayport/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-machining-type~drilling&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=red-metal-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5776K35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225776K35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/for-use-on~air-compressors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~1-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131390%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dye-penetrants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-machining-type~milling&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/connection-type~displayport&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:43:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/for-shaft-diameter~1-7-8/
2026-01-04 09:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamp-on-reducers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gate-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5776K35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225776K35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-use-on~air-compressors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145947%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/connection-type~displayport/
2026-01-04 09:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~33-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~34-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dye-penetrants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30737 pages (at 44 pages/min), scraped 674 items (at 0 items/min)
2026-01-04 09:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930072%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~36-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/connection-style~clamp-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~21-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5776K35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225776K35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~33millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~186-1-0-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~34millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reducers/connection-style~clamp-on/
2026-01-04 09:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~33millimeters/
2026-01-04 09:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~36millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~34millimeters/
2026-01-04 09:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-diameter~3-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-008&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~21mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5776K35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225776K35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~52-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/for-use-with~ammonia/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~186-1-0&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~36millimeters/
2026-01-04 09:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038924%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/for-shaft-diameter~21mm/
2026-01-04 09:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~186-1-0/
2026-01-04 09:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-diameter~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/electrical-connection~coaxial&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-026/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~52millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~anhydrous-ammonia&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/manufacturer-model-number~pr-1205&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~501-b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/for-shaft-diameter~3-1-2/
2026-01-04 09:45:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/edm-fluids/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-026/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~52millimeters/
2026-01-04 09:45:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reducers/for-use-with~anhydrous-ammonia/
2026-01-04 09:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30783 pages (at 46 pages/min), scraped 675 items (at 1 items/min)
2026-01-04 09:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7559498251638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7559498251638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002150314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-034&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-026/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 09:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:18 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-026/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 09:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/for-use-with~hydrogen/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/cable-designation~sjeo/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~svt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7693K86&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227693K86%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~501-b&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=edm-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/shaft-type~keyed/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~hydrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/industry-designation~sjeo&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/drive-size~no-17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/trade-name~break-free-clp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/industry-designation~svt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=probe-stylus-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/material~foam-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~a-19-alc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/for-shaft-type~keyed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967523%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/industry-designation~sjeo/
2026-01-04 09:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/industry-designation~svt/
2026-01-04 09:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/for-shaft-type~keyed/
2026-01-04 09:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9066N416&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229066N416%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/size~no-17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~b-2480-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~break-free-clp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/material~foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~a-19-alc&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/size~no-17/
2026-01-04 09:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088071%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-138&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30829 pages (at 46 pages/min), scraped 676 items (at 1 items/min)
2026-01-04 09:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-143&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/reducers/material~foam/
2026-01-04 09:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~200-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9066N416&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229066N416%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~b-2480&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1172K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221172K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000089088%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000082249%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~21-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622923%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~b-2480/
2026-01-04 09:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001607702%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7734T548&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227734T548%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9066N416&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229066N416%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047278%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8329T36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228329T36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~0-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~g-453-er&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/gauge-size~13-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/trade-name~lb-c-200-high-temperature-solid-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=programmable-timer-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9066N416&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229066N416%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/length~45-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000089653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148592%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000146025%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:11 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148592%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~g-453-er&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30880 pages (at 51 pages/min), scraped 679 items (at 3 items/min)
2026-01-04 09:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~lb-c-200-high-temperature-solid-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=propane-gas-cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-ff-rk-cs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~45ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-insulating-retrievers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-ws-rk-cs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-insulating-sleeving/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/shaft-diameter~35-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123468%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/length~45ft-/
2026-01-04 09:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-er15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-insulating-sockets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002259249%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:37 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123468%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-ff-rk-cs&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulating-retrievers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125323%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-ws-rk-cs&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulating-sleeving&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/trade-name~molykote-112-high-performance/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-er15&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-insulating-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/force-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pants/application~electrical-protection-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extension%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~98-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrical-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cords/nema-type~l6-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7197K18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227197K18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~molykote-112-high-performance&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/length~98-ft-/
2026-01-04 09:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30926 pages (at 46 pages/min), scraped 679 items (at 0 items/min)
2026-01-04 09:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=propress-unions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/trade-name~molykote-g-0050-fm-white-ep/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/force-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducing-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100027%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrical-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/nema-style~l6-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/force-gauges/
2026-01-04 09:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electromagnet-power-units/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1204K42&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221204K42%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/extension-cords/nema-style~l6-15/
2026-01-04 09:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~molykote-g-0050-fm-white-ep&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducing-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gear-and-bearing-pullers/thread-size~m14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128205%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electromagnet-power-units&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-spring-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=protective-nets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gear-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2699428871106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gear%20and%20bearing%20pullers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2699428871106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1445K41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221445K41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~s65-230&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=prototyping-materials&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138129%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 30976 pages (at 50 pages/min), scraped 682 items (at 3 items/min)
2026-01-04 09:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/trade-name~thk-afg/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~sjt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2699428871106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gear%20and%20bearing%20pullers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2699428871106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=general-purpose-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=general-purpose-mixers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extensions/socket-type~torque-and-angle-measuring-adapter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reflective-vehicle-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/elevator-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138129%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9996540530177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=extensions&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9996540530177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002466775%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~thk-afg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/industry-designation~sjt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2699428871106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gear%20and%20bearing%20pullers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2699428871106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1989N43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221989N43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reflective-vehicle-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089658%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/industry-designation~sjt/
2026-01-04 09:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-partition-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=elevator-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138129%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2317N2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222317N2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=generator-cables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2699428871106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gear%20and%20bearing%20pullers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2699428871106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=external-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-filter-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lavatory%20equipment&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138129%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lawn-sprinkler-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=external-retaining-rings/retaining-ring-style~push-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31027 pages (at 51 pages/min), scraped 684 items (at 2 items/min)
2026-01-04 09:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pry-bars/performance~nonsparking-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glide-insert-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-flowmeters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~16v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6646950986674&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=external%20retaining%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6646950986674%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002055835%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4384936329327&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pry%20bars&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4384936329327%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002235310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-filter-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ptfe-coated-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4384936329327&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pry%20bars&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4384936329327%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002235310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pry-bars/performance~nonsparking-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98430A114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298430A114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-flowmeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/voltage~30v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ptfe-joint-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~0-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-mallets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98430A114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298430A114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-only-sorbents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/color~orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~rtv116&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue-dots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/engineers-measuring-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110661%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31078 pages (at 51 pages/min), scraped 684 items (at 0 items/min)
2026-01-04 09:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98430A114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298430A114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-only-sorbents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-removal-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6604A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226604A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001703296%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screw-nuts/thread-size~1-1-4-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=engineers%27-measuring-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997045507261&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screw%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997045507261%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98430A114&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298430A114%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-removal-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/envelopes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ptfe-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil-skimmer-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95365A143&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295365A143%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screw-nuts/thread-size~1-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553666%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eye-wash-station-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997045507261&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screw%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997045507261%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=envelopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ergonomic-stools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/regulators/outlet-pipe-size~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-skimmer-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1710K5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221710K5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/body-style~without-shoulder&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31127 pages (at 49 pages/min), scraped 686 items (at 2 items/min)
2026-01-04 09:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ethanol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ergonomic-stools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001923991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/outlet-pipe-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reinforced-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002065934%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:30 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ethanol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/mount-type~magnetic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reinforced-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A978&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A978%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~1-1-8-7-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/on-delay-timers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/relays/input-voltage~480v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-screws/thread-size~m2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nuts/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334544%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~1-1-8-7-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/open-end-hand-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=on-delay-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pull-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7896753628184&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cap%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7896753628184%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31177 pages (at 50 pages/min), scraped 688 items (at 2 items/min)
2026-01-04 09:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relays/input-voltage~480v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~m30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7088615684115&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7088615684115%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/expansion-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extendable-scrapers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~m36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-ladders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulley-and-sprocket-bushings/shaft-diameter~30-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:44 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~m30&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-spring-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=expansion-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extendable-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/optical-touch-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1185587692173&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pulley%20and%20sprocket%20bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1185587692173%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002257887%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:53:56 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=eyebolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~m36&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/for-use-with~organic-vapors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2344K34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222344K34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/orifice-unions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/orifice-valve-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=optical-touch-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1206504422411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1206504422411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31225 pages (at 48 pages/min), scraped 689 items (at 1 items/min)
2026-01-04 09:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eye-wash-aerators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=organic-vapors-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=f26-felt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/casters/environment~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=orifice-unions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=orifice-valve-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fabric-reinforced-buna-n-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grip-lock-and-twist-claw-hose-to-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eye-wash-aerators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/belt-trade-size~3l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=face-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/environment-1~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/outlets/current-voltage~0-5-amp-100v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pulleys/belt-trade-size~at10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/casters/environment-1~food-and-beverage/
2026-01-04 09:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fall-arrest-snaps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/for-belt-trade-size~3l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/wheel-diameter~2-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-welding-hose-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/current~0-5-a-100-v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/for-belt-trade-size~at10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/outlets/current~2-4-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pulleys/for-belt-trade-size~3l/
2026-01-04 09:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=casters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001919827%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31274 pages (at 49 pages/min), scraped 689 items (at 0 items/min)
2026-01-04 09:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lego-style-transfers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/outlets/current~0-5-a-100-v-ac/
2026-01-04 09:55:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pulleys/for-belt-trade-size~at10/
2026-01-04 09:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fall-arrest-snaps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fast-travel-acme-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9008T44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229008T44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cellulose-sheet-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirator-filters/respirator-filter-rating~n95/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/current~2-4a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cement/for-use-on~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grounding-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fast-travel-acme-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/outlets/current~2-4a/
2026-01-04 09:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirators/compatible-with~3m-5000-series/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirators/compatible-with~3m-7000-series/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2960338757520&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cement&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2960338757520%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929750%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirator-filters/filter-rating~n95&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grounding-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fall-restraint-harnesses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fda-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4796A1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224796A1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/respirator-filters/filter-rating~n95/
2026-01-04 09:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oval-head-machine-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/compatible-with~3m-5000-series&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/compatible-with~3m-7000-series&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:55:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirators/for-use-with~ethyl-acetate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fence-post-pullers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~1-4-28-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pulleys/v-belt-type~cogged&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fda-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138884%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002097615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31321 pages (at 47 pages/min), scraped 691 items (at 2 items/min)
2026-01-04 09:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8470423702633&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pulleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8470423702633%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001593326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oval-head-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5834T24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225834T24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5834T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225834T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/for-use-with~ethyl-acetate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fence-post-pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-number~04b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-4-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967510%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8304400284430&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8304400284430%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132946%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/levels/thread-size~1-4-28/
2026-01-04 09:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferraz-shawmut-type-rfs-fuses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~08b-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7846A1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227846A1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=levels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/roller-chain-trade-number~50-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gusset-corner-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hairpin-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~05b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirators/manufacturer-model-number~n75004l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferraz-shawmut-type-rfs-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/roller-chain-trade-size~05b/
2026-01-04 09:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~08b-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-size~50-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/overpack-drums/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiber-optic-cable-cutters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lid-supports/opening-closing-action~soft-close/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/roller-chain-trade-size~08b-2/
2026-01-04 09:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/for-use-with~sewage-water-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammer-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/manufacturer-model-number~n75004l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/roller-chain-trade-size~50-5/
2026-01-04 09:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31370 pages (at 49 pages/min), scraped 694 items (at 3 items/min)
2026-01-04 09:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oxyacetylene-welders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-packing-insulation/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074102%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=overpack-drums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiber-optic-cable-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lid-supports/opening-closing-action~soft-closing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/current~20-0-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=54445T239&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2254445T239%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oxyacetylene-welders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lid-supports/opening-closing-action~soft-closing/
2026-01-04 09:57:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004952616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-packing-insulation&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/file-cards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/p-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:44 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004952616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/current~20-0-amp&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fill-in-paint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/file-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/film-sealers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=file-cards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=p-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifts/fitting-type~rope-end&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filter-breathers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chrome-moly-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fill-in-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31418 pages (at 48 pages/min), scraped 695 items (at 1 items/min)
2026-01-04 09:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=file-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=film-sealers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179289%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 09:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9983427256512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lifts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9983427256512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001927425%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/packaging-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/voltage~115v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filter-breathers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fine-line-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/finger-brakes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/power-source~add-a-motor&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packaging-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-keys/chuck-key-number~r13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3556277725899&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3556277725899%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076402%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/thread-size~m5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pumps/voltage~115v-ac-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fine-line-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handles/thread-size~m6-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finger-brakes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9311230464378&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chuck%20keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9311230464378%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002057340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=handles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pumps/voltage~115v-ac-1/
2026-01-04 09:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/retractors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chuck-keys/chuck-key-number~tk5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3169A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223169A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/padded-mailers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/punches/hole-diameter~1-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paddle-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/padlock-anchors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/thread-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31464 pages (at 46 pages/min), scraped 696 items (at 1 items/min)
2026-01-04 09:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/handles/thread-size~m6/
2026-01-04 09:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamps/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chuck-keys/key-number~tk5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=padded-mailers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/for-hole-diameter~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paddle-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~23-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=padlock-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chuck-keys/key-number~tk5/
2026-01-04 09:59:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/punches/for-hole-diameter~1-3-4/
2026-01-04 09:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~26-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fire-retardant-blankets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/material~cork-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cleaners/for-use-on~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014467%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/clamps/material~aluminum/
2026-01-04 09:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/fire-sprinkler-heads already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamps/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 09:59:57 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000014467%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~26-1-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 09:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-retardant-blankets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/material~rubber-cork-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/mount-type~hook-and-loop/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929691%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-on~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/clamps/material~fiberglass/
2026-01-04 10:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fire-sprinkler-heads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/material~plastic-fiber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pads/material~rubber-cork-blend/
2026-01-04 10:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cleaners/for-use-on~iron/
2026-01-04 10:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31508 pages (at 44 pages/min), scraped 696 items (at 0 items/min)
2026-01-04 10:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/hole-diameter~1-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/mount-type~hook-and-loop&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clips/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-sprinkler-heads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~70&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/finish~plastic-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/material~synthetic-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001669592%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/fitting-type~carabiner&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-resistant-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pads/material~synthetic-fiber/
2026-01-04 10:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937577%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flame-resistant-duct-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/clips/material~iron/
2026-01-04 10:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flange-isolation-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/mounting-location~din-rail&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flap-sanding-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flame-resistant-duct-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/hole-diameter~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276055%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/hole-diameter~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-sinks/thread-type~npt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cloth/material~fabric-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001670991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31559 pages (at 51 pages/min), scraped 696 items (at 0 items/min)
2026-01-04 10:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flange-isolation-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001673542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9615546959836&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heat%20sinks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9615546959836%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968537056579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cloth&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968537056579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511101%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flap-sanding-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276055%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=35205K16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2235205K16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape-number~t2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/drive-style~one-way-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flashlight-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rigid-conduit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/hole-diameter~36-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276055%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flashlight-lenses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-treating-foil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=punches/hole-diameter~44-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K563&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K563%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002234989%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/drive-style~one-way&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flashlight-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002264182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rigid-conduit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276055%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flashlight-lenses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fasteners/drive-style~one-way/
2026-01-04 10:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flat-head-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coatings/for-use-on~titanium-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31608 pages (at 49 pages/min), scraped 698 items (at 2 items/min)
2026-01-04 10:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flaw-detection-developers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heaters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002264182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1076&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/for-use-on~plastic-1/for-use-on~pvdf/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heating-tape/hazardous-location-rating~aex-tb-iiic-db&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-head-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coatings/for-use-on~titanium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flaw-detection-developers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1156dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6091842072381&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heating%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6091842072381%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138763%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002264182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~cadmium-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/coatings/for-use-on~titanium/
2026-01-04 10:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T26&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T26%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/for-use-on~pvdf-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321550%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=36005K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2236005K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/for-use-on~vinyl-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/paint-type~dry-fall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539197%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/paint/for-use-on~pvdf-plastic/
2026-01-04 10:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T8&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T8%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:02:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5113201929937&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5113201929937%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002264182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/finish~wax-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-button-butt-splices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/military-specification~ms122091/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/for-use-on~vinyl-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/paint-type~dry-fall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31656 pages (at 48 pages/min), scraped 700 items (at 2 items/min)
2026-01-04 10:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-buttons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930411%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helmets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969226%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~waxed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/military-specifications-met~ms122091&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint-sprayer-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1815&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T8&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T8%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930411%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/for-use-on~vinyl-fabric&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:03:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fasteners/finish~waxed/
2026-01-04 10:03:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/helicoils/military-specifications-met~ms122091/
2026-01-04 10:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~1873&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325574%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/diameter~0-157/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/diameter~0-197/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/diameter~0-246/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325984%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-sprayer-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T8&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T8%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/material~rubber-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~193&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/diameter~0-157&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/diameter~0-197&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/diameter~0-246&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320963%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conduit/fitting-type~reducing-adapter/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T8&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T8%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528872%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557270%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T506&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T506%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31707 pages (at 51 pages/min), scraped 700 items (at 0 items/min)
2026-01-04 10:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-testers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98919A027&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298919A027%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98919A051&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298919A051%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90219A340&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290219A340%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/type~reducing-adapter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-close-latches/key-number~ch751&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/conduit/type~reducing-adapter/
2026-01-04 10:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T506&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T506%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5522819982500&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=push%20to%20close%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5522819982500%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400803%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-performance-lithium-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:43 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5522819982500&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=push%20to%20close%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5522819982500%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400803%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-close-latches/key-number~ch751&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flush-valve-spud-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~28psb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T506&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T506%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-close-latches/material~nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5522819982500&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=push%20to%20close%20latches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5522819982500%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511113%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/thread-type~nptf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flush-valve-spud-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~1-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8034K5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228034K5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-polish-sanitary-tube-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T506&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T506%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-strength-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contact-tips/for-manufacturer~lincoln&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31760 pages (at 53 pages/min), scraped 703 items (at 3 items/min)
2026-01-04 10:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975110708676&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=contact%20tips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975110708676%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123093%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foam-tipped-swabs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foam-wrap-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foam-pouches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=push-to-connect-tube-fittings-for-flame-retardant-polyethylene-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/material~fiberglass-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~1-3-8-6-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003423545%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-tipped-swabs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-wrap-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/folding-benches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-pouches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~378&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/folding-desks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~composite-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~11-32-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-brackets/material~plastic-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T128&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T128%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31811 pages (at 51 pages/min), scraped 704 items (at 1 items/min)
2026-01-04 10:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/panel-mount-led-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/panel-mount-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinge-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=putty&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003433251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~2-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5916227542932&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5916227542932%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=folding-desks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-mount-led-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~11-32-24&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-industry-batch-cans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/mount-type~weld-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-mount-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A008&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A008%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~plastic-1/for-use-on~ptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-industry-batch-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~plastic-1/for-use-on~pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~plastic-1/for-use-on~pvdf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/hinges-without-holes-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/putty/for-use-on~plastic-1/for-use-on~polypropylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=putty&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robot-attachments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/number-of-teeth-per-sprocket~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=putty&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=putty&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940452%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223186800911374%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530018%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31860 pages (at 49 pages/min), scraped 706 items (at 2 items/min)
2026-01-04 10:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=16175A12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2216175A12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~polypropylene-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-attachments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5921K103&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225921K103%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~53x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/putty/for-use-on~polypropylene-plastic/
2026-01-04 10:07:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyors/length~5-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320899%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robot-tool-changers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=putty/for-use-on~vinyl-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~656&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foreline-traps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=951457901010&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B951457901010%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001599292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T024&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T024%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6292651935014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=putty&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6292651935014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324143%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper/temper-rating~soft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~6psb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-tool-changers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-backed-strip-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7997K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227997K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5368696224678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=copper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5368696224678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002292944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foreline-traps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-(schedule-80)-dark-gray-unthreaded-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T024&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T024%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5175K221&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225175K221%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~gripper/manufacturer~universal-robots/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~switch-padding/for-robot-arm-manufacturer~fanuc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31911 pages (at 51 pages/min), scraped 709 items (at 3 items/min)
2026-01-04 10:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~795x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T024&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T024%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foundry-metals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320620%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paper-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~gripper/manufacturer~universal-robots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~safety-padding/manufacturer~fanuc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9613T131&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229613T131%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T024&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T024%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142085%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002259996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foundry-metals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/material~rubber-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3767N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223767N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/material~paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~917&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/material~rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m75&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326975%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-pipe-p-traps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/material~rubber/
2026-01-04 10:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fasteners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449101%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 31963 pages (at 52 pages/min), scraped 712 items (at 3 items/min)
2026-01-04 10:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-pipe-reducing-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-pipe-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-pipe-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoppers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/parallel-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuel-containers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/parallel-ground-screwdrivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~dys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/color~black-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~enx-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/parabolic-light-diffusers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuel-tank-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parallel-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuel-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fastening%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002189335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002323514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parallel-ground-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9992T12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229992T12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuel-tank-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/parabolic-light-diffusers already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/parking-barricades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T908&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T908%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32009 pages (at 46 pages/min), scraped 714 items (at 2 items/min)
2026-01-04 10:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/counterbores/screw-size~5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/parking-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/form~rectangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fastening-tape/width~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~eyb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parking-barricades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fastening%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084411%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvc-tubes-for-chemicals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counterbores/for-screw-size~5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/parabolic-light-diffusers> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Destination host connect timeout'}]
2026-01-04 10:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:31 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/parabolic-light-diffusers>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Destination host connect timeout'}]
2026-01-04 10:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parking-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~wet-abrasive-materials&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321257%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/counterbores/for-screw-size~5-8/
2026-01-04 10:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/screw-size~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/width~1-1-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005512023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuse-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fastening-tape/width~1-1-4-1/
2026-01-04 10:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6173N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226173N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/width~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/g-force-indicators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvdf-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/for-screw-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/specifications-met~sae-j517&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fastening%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000035522%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuse-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/countersinks/for-screw-size~1-4/
2026-01-04 10:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32057 pages (at 48 pages/min), scraped 715 items (at 1 items/min)
2026-01-04 10:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/parts-washer-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76405A24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276405A24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaffers-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9459K221&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229459K221%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pvdf-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/patch-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersunk-head-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parts-washer-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76405A24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276405A24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaffers%27-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucet-cartridges/for-manufacturer~watersaver&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=qa-stamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9459K221&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229459K221%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3621951154988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=faucet%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3621951154988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=patch-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/galvanized-steel-tab-collars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~2-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76405A24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276405A24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:11:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9459K221&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229459K221%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-diameter~3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanized-steel-tab-collars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32105 pages (at 48 pages/min), scraped 715 items (at 0 items/min)
2026-01-04 10:12:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~2-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=76405A24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2276405A24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:12:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-trade-number~hpr53&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9459K221&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229459K221%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-shaft-diameter~2-3-8/
2026-01-04 10:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/garden-hose-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-diameter~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002326317%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-154/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~delta&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3621951154988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=faucet%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3621951154988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-shaft-diameter~3/
2026-01-04 10:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1003ll/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K175&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K175%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/fitting-connection~barbed-2/shape~90-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=faucets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123171%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gasket-eliminators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=garden-hose-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-154&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=faucets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123171%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~delta&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose-fittings/connection-style~barbed/material~brass/
2026-01-04 10:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1003ll&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/peek-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/peelable-solder-masks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gasket-eliminators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:12:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1003ll/
2026-01-04 10:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1093/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/peel-coats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A235&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A235%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeding-bins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gatorade/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32148 pages (at 43 pages/min), scraped 717 items (at 2 items/min)
2026-01-04 10:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=peek-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3621951154988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=faucet%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3621951154988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=peelable-solder-masks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~0-242/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1093&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-005/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pegboard-hangers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=peel-coats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gatorade&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1093/
2026-01-04 10:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-242&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-0050&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/thread-size~3-4-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pegboard-hangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/shaft-diameter~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-0202/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523577%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/thread-type~bspp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~0-0050/
2026-01-04 10:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128867%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A184&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A184%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000037076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pen-magnets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-disconnect-spray-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-045/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3621951154988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=faucet%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3621951154988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 504 Gateway Time-out
2026-01-04 10:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:13:55 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <504 https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3621951154988&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=faucet%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3621951154988%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true>: HTTP status code is not handled or not allowed
2026-01-04 10:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-0202&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-10005/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~0-0202/
2026-01-04 10:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/people-working-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-116/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pen-magnets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32196 pages (at 48 pages/min), scraped 718 items (at 1 items/min)
2026-01-04 10:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-0450&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quick-read-measuring-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~0-0450/
2026-01-04 10:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-10005&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=people-working-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-1160&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~1-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~0-10005/
2026-01-04 10:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/perforated-electrical-enclosure-panels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~1-4-1/diameter~0-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-04-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauge-blocks/size~0-1160/
2026-01-04 10:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073039%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1893/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/drive-size~1-11-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=perforated-electrical-enclosure-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=quiet-stem-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-04mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/perforated-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:14:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/drive-size~1-11-16-1/
2026-01-04 10:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1891/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~1-4/
2026-01-04 10:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1893&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/feeler-gauges/thickness~0-04mm/
2026-01-04 10:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32240 pages (at 44 pages/min), scraped 718 items (at 0 items/min)
2026-01-04 10:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/peristaltic-pumps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1893/
2026-01-04 10:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~11-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=perforated-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=r362%252f19-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1891&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/permatex-gasket-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-1mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=peristaltic-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=r-style-marine-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~1891/
2026-01-04 10:15:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/feeler-gauges/thickness~0-1mm/
2026-01-04 10:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/personal-cooling-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=current-meters/display-type~digital&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/personnel-safety-tethers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=permatex-gasket-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~2-25-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5141729687232&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=current%20meters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5141729687232%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001939551%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measures~compression/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/petrolatum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=personal-cooling-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feet/mount-type~hammer-on/mount-type~tack/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=personnel-safety-tethers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtains/color~red&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~2-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-25-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~compression&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8163625184607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=curtains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8163625184607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~2-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32285 pages (at 45 pages/min), scraped 718 items (at 0 items/min)
2026-01-04 10:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=petrolatum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/mount-type~hammer-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8163625184607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=curtains&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8163625184607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curtains/color~red&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95090A133&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295090A133%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/feet/mount-type~hammer-in/
2026-01-04 10:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/groove-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/shape~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~2-5mm/
2026-01-04 10:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~334/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cutters/for-use-on~brass/
2026-01-04 10:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8031429930803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8031429930803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000141509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=racks/component~gear-rack&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/pulley-diameter-checkers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gear-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=684483403398&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=racks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B684483403398%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002237364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-swivel-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~334&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%226120075177463%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/material~cobalt-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/racks/mobility~stationary/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cutters/for-use-on~iron/
2026-01-04 10:17:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~334/
2026-01-04 10:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gear-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32333 pages (at 48 pages/min), scraped 719 items (at 1 items/min)
2026-01-04 10:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/geiger-counters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~3-75-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%226120075177463%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/thread-size~5-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinders/body-material~stainless-steel-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gfci-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8031429930803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=feet&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8031429930803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453021%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=geiger-counters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~3-75mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4958019197274&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cylinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4958019197274%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001574024%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%226120075177463%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dampers/material~foam-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dampers/material~plastic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/diameter~3-75mm/
2026-01-04 10:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gfci-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~4-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994033470274&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dampers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994033470274%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511275%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=radial-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/phenolic-film/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994033470274&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dampers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994033470274%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/depth-gauges/manufacturer-model-number~571-213-10-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:17:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%226120075177463%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=impact-driver-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glass-tube-fuses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glazing-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32379 pages (at 46 pages/min), scraped 719 items (at 0 items/min)
2026-01-04 10:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glove-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fencing/fencing-component~barbed-wire-support-for-support-posts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-gauges/manufacturer-model-number~571-213-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=impact-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533158%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/depth-gauges/manufacturer-model-number~571-213-10/
2026-01-04 10:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-tube-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~67np/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glazing-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rail-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glove-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glow-sticks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pick-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/goggle-headbands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-rail-mounting-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/goggle-storage-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~67np&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=displays/display-type~scale&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glow-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:18:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~67np/
2026-01-04 10:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=industrial-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962059121163&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=displays&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962059121163%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001933428%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pick-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=industrial-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=goggle-headbands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/picks/tip-style~blunt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=goggle-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32428 pages (at 49 pages/min), scraped 719 items (at 0 items/min)
2026-01-04 10:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/signs/message~railroad-crossing-symbol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fencing/fencing-component~privacy-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~90/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/doors/mounting-location~hinge/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~9004-100-80w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/picture-frames/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/fencing/fencing-component~privacy-strips/
2026-01-04 10:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=picks/tip-style~blunt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-etd-150-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=railroad-track-brooms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=railroad-crossing-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5551314863993&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5551314863993%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002256570%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~90&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=doors/mount-type~hinge&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~9004-100-80w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=picture-frames&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inline-air-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~90/
2026-01-04 10:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1093630895265&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=doors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1093630895265%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011072%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~9004-100-80w/
2026-01-04 10:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-etd-150-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~9007/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~1-14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pig-ring-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:19:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~1-4-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fep-encapsulated-o-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~923/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pillow-block-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~9007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~1-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32472 pages (at 44 pages/min), scraped 719 items (at 0 items/min)
2026-01-04 10:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fep-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pig-ring-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~2-1-2-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~9007/
2026-01-04 10:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~1-4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~923&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pillow-block-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~5-16-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451929%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~e211-2r/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~2-1-2-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~923/
2026-01-04 10:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~2-1-4-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K694&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K694%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=raised-face-slip-on-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rods/thread-size~2-1-2-4/
2026-01-04 10:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/terminal-type~wire-ferrule-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~m20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pin-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~e211-2r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~13-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~2-1-4-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~e211-2r/
2026-01-04 10:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/electrical-connection-component~terminal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105747%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/fitting-type~reducer-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32519 pages (at 47 pages/min), scraped 720 items (at 1 items/min)
2026-01-04 10:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ferrules/electrical-connection-component~terminal/
2026-01-04 10:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~m14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheel-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001931087%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-workstations/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grip-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5237K442&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225237K442%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~m14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheel-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/for-use-with~hydrofluoric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~f48t12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/for-use-with~iron-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-workstations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grip-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334532%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965135%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5237K442&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225237K442%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968005%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gripple-rope-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7436T131&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227436T131%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~f48t12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7436T711&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227436T711%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5237K442&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225237K442%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~f48t12/
2026-01-04 10:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~0-625&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32569 pages (at 50 pages/min), scraped 722 items (at 2 items/min)
2026-01-04 10:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gripple-rope-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pincers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/thread-size~m5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pinch-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001612590%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hollow-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5237K442&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225237K442%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4322K261&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224322K261%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~fpc55/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratcheting-levers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grounding-reels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pincers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:36 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/thread-size~m5&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pinions/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pinch-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/bit-style~hollow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~fpc55&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grounding-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/bit-style~hollow/
2026-01-04 10:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~h4-75-70w-24v/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pinions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~26-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchets/square-drive-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~fpc55/
2026-01-04 10:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ratchets/square-drive-size~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=internal-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammer-drill-chucks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988466368360&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ratchets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988466368360%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32612 pages (at 43 pages/min), scraped 723 items (at 1 items/min)
2026-01-04 10:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammer-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988466368360&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ratchets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988466368360%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000056258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~h4-75-70w-24v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=internal-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~26mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/trade-number~h4-75-70w-24v/
2026-01-04 10:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammer-head-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ferrules/length~26mm/
2026-01-04 10:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammer-drill-chucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammer-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-diameter~12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hand-held-electrical-enclosures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ferrules&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001611514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rca-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammer-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4322K191&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224322K191%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=irrigation-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-012/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-034/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-diameter~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-held-electrical-enclosures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000168397%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hand-presses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-057/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-034&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2478K115&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222478K115%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32657 pages (at 45 pages/min), scraped 724 items (at 1 items/min)
2026-01-04 10:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamer-sets/material~cobalt-steel/reamer-type~for-dowel-pin-holes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~12-5v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-012&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540781%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jacobs-chucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7218065360791&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamer%20sets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7218065360791%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003458002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552896%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-057&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540781%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-034&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~21v-dc-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ferrules/material~aluminum/
2026-01-04 10:24:33 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7218065360791&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamer%20sets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7218065360791%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512485%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003458002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamer-sets/material~cobalt-steel/reamer-type~for-dowel-pin-holes&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T094&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T094%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-076/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handle-grip-wrap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hands-free-faucet-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-091/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-057&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/drill-bit-size~59-ga-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T094&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T094%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/for-use-on~hardened-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~21v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-076&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handle-grip-wrap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hands-free-faucet-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-091&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929763%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/drill-bit-size~59-ga-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/voltage~21v-dc/
2026-01-04 10:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523842%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32704 pages (at 47 pages/min), scraped 725 items (at 1 items/min)
2026-01-04 10:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542497%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T094&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T094%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/drill-bit-size~59-ga-/
2026-01-04 10:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~12-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:19 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523842%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-076&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-122/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542497%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-091&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929763%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-1251/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reamers/system-of-measurement~metric/material~carbide/shank-type~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/material~steel-2/material~high-speed-steel/reamer-type~for-dowel-pin-holes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T094&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T094%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/harmonized-european-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~12-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-122&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/harsh-chemical-spill-control-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929763%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~16-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000105125%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-1251&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=harmonized-european-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/metric-size-carbide-round-shank-reamers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5890K306&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225890K306%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:25:59 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554673%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-122&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528151%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=harsh-chemical-spill-control-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reamers/metric-size-carbide-round-shank-reamers/
2026-01-04 10:26:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929763%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~16-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:10 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528151%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-1251&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32750 pages (at 46 pages/min), scraped 726 items (at 1 items/min)
2026-01-04 10:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hastelloy-x/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000100758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hazardous-location-heat-blankets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~20-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0280&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~1-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2245T3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222245T3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0440&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001591770%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hastelloy-x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001614237%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067866%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-location-heat-blankets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~20-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:43 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0280&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:26:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000067866%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0440&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~0-188/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hdmi-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hdmi-ports/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rollers/roller-width~20mm/
2026-01-04 10:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~1-66-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/headbands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~142-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/10-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-188&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keyed-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hdmi-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hdmi-ports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32795 pages (at 45 pages/min), scraped 727 items (at 1 items/min)
2026-01-04 10:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=headbands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~142mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000118628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~11-6-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~10w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/length~142mm/
2026-01-04 10:27:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000118628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-188&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~29-19-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~168-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~10w/
2026-01-04 10:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-reflective-aluminized-clothing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0785&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-resistant-hats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~11-6w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~29-19-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0795&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-(frp)-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~168mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000049593%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~11-6w/
2026-01-04 10:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-reflective-aluminized-clothing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000029078%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:27:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/length~168mm/
2026-01-04 10:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~2-13-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-resistant-hats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2277T32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222277T32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-resistant-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0845&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32843 pages (at 48 pages/min), scraped 727 items (at 0 items/min)
2026-01-04 10:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0880&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0890&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~2-13-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0940&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-resistant-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000071243%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0845&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-bar-grating&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092216%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001602810%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-blankets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069462%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~1-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/thread-size~6-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092216%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0890&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:28:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0880&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:28:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069462%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-0940&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~1-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-width~9-9-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knurled-head-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~24-2-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knurled-thumb-screw-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~23-7-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~1w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~9-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001491500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~1w/
2026-01-04 10:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32894 pages (at 51 pages/min), scraped 728 items (at 1 items/min)
2026-01-04 10:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087940%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barrel-drift-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~24-2w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~0-079/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l1154-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5890K304&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225890K304%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~24-2w/
2026-01-04 10:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~26-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/double-taper-hole-alignment-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~0-079&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~50-79-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~47-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001490279%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pins/double-taper-hole-alignment-pins/
2026-01-04 10:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-threaded-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-track-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~0-079/
2026-01-04 10:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1647N6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221647N6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-alignment-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~no-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~50-79mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~47-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:29:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lags/fastener-head-type~hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/length~50-79mm/
2026-01-04 10:30:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~47-mm/
2026-01-04 10:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1647N6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221647N6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/hole-alignment-pins-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~no-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32942 pages (at 48 pages/min), scraped 729 items (at 1 items/min)
2026-01-04 10:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~7-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~8-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pins/hole-alignment-pins-6/
2026-01-04 10:30:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lags/head-type~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hex-drivers/size~no-16/
2026-01-04 10:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~36-1-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bits/overall-length~82-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597727%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/pin-type~cotter/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1647N6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221647N6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lags/head-type~hex/
2026-01-04 10:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~4-3-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001491348%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~8-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope/diameter~0-100/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/length~82mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001603996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/pin-type~cotter/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1647N6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221647N6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~4-3w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001491348%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/drill-bits/length~82mm/
2026-01-04 10:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969789%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope/diameter~0-100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/light-bulbs/wattage~4-3w/
2026-01-04 10:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope/diameter~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope/diameter~13-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latex-caulk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 504 Gateway Time-out
2026-01-04 10:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7090012887875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7090012887875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:30:58 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <504 https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000157155%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true>: HTTP status code is not handled or not allowed
2026-01-04 10:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope/diameter~7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/files/for-use-on~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001491348%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2078T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222078T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 32987 pages (at 45 pages/min), scraped 729 items (at 0 items/min)
2026-01-04 10:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope/diameter~13-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~1-2-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/thread-size~1-1-4-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope/diameter~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope-ends/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=files/for-use-on~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7090012887875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7090012887875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547776%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~6-72-w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001491348%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7090012887875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7090012887875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000149734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/files/for-use-on~fiberglass/
2026-01-04 10:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001490350%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead/specifications-met~astm-b29&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/high-vacuum-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T217&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T217%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead/thickness~0-2500/thickness~0-25/thickness~0-250/thickness~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rope-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8678154003786&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8678154003786%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8678154003786&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lead&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8678154003786%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001453678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001455863%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=high-vacuum-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097288%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T217&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T217%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2367&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33038 pages (at 51 pages/min), scraped 730 items (at 1 items/min)
2026-01-04 10:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leashes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pioneer-shape-hose-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2430&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-starters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pioneer-shape-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021676%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T217&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T217%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152330%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065527%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pioneer-shape-hose-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:36 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065527%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2430&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pioneer-shape-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021676%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9527T217&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229527T217%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-use-on~plastic-1/for-use-on~ptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lindstrom-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hoist-pendants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2650&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hoisting-chains/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fillers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021676%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leveling-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoist-pendants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2650&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leveling-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33089 pages (at 51 pages/min), scraped 730 items (at 0 items/min)
2026-01-04 10:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hoisting-chains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotating-joint-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~3-9-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000021676%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-detectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hollow-lock-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132114%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2755&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotating-joint-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-end-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~4-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000156995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-detectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hollow-lock-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152976%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000156995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2755&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filter-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-end-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152976%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~4-11-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:33:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/finish~nickel-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2905&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levers/handle-type~fixed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/horizontal-band-saws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-clamp-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000170091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33137 pages (at 48 pages/min), scraped 730 items (at 0 items/min)
2026-01-04 10:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978677157349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=levers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978677157349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001932515%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/finish~nickel-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filter-media-pad-frames&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~66-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000170091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-2905&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lifting-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978677157349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=levers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978677157349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001932515%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levers/handle-type~fixed&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=horizontal-band-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-clamp-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000049798%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rounded-end-machine-keys/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=drill-bits/overall-length~86-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/routing-eyes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3240&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lip-and-spur-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2657592637062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=drill%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2657592637062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000096805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-flux&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/for-use-with~deionized-water-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape~spotlight-floodlight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=routing-eyes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967804%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rounded-end-machine-keys&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=light%20bulbs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-waste-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/for-use-with~natural-gas-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lithographers-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33190 pages (at 53 pages/min), scraped 730 items (at 0 items/min)
2026-01-04 10:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1535K62&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221535K62%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-pipes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/for-use-with~natural-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/for-use-with~nuisance-dust&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lithographers%27-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3570&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=limit-switches/environment~corrosive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/filters/for-use-with~natural-gas/
2026-01-04 10:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/pipe-fittings/pipe-size~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967367%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2001310163167&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=limit%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2001310163167%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/hvac-filter-trade-size~15-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/pipe-size~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=55815T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2255815T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000167615%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000131190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3570&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002065926%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3805&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber/shape~sheet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/thread-type~npt/pipe-size~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3810-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018411%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-aprons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/pipe-size~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147677%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33238 pages (at 48 pages/min), scraped 732 items (at 2 items/min)
2026-01-04 10:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3920&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~18-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:14 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018411%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3805&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/shape~sheet-and-bar&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/thread-type~npt/pipe-size~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147677%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3810-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/hvac-filter-trade-size~6-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-aprons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313229%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111007%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-3920&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locating-pin-retractors/power-source~air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/hvac-filter-trade-size~18-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locating-shanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3355991442690&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=locating%20pin%20retractors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3355991442690%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005076415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002060875%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4045&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/i-beam-tube-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4080&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4125&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102508%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/merv-filter-rating~15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000023506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-level-float-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=i-beam-tube-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:08 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102508%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4080&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9862682945404&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9862682945404%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002066598%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-level-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33293 pages (at 55 pages/min), scraped 732 items (at 0 items/min)
2026-01-04 10:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-slides&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000023506%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4125&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iec-relays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000158851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~union-1/pressure-class~1000/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~18-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~union-1/thread-type~bspt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-floor-flanges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-flange-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locknuts/military-specification~ms21045-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iec-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/pressure-class~1000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~18-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-fittings/type~union/thread-type~bspt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-floor-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000109497%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-flange-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/filters/trade-size~18-18/
2026-01-04 10:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:37:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7983833808297&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7983833808297%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locknuts/military-specifications-met~ms21045-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~24-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5289N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225289N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=load-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33334 pages (at 41 pages/min), scraped 732 items (at 0 items/min)
2026-01-04 10:38:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/locknuts/military-specifications-met~ms21045-9/
2026-01-04 10:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~48-72/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indicating-silica-gel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loading-docks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~24-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4590&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/garment~finger-cot/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4665&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~48-72&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4685&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/filters/trade-size~24-30/
2026-01-04 10:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicating-silica-gel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/for-use-on~glass-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152090%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034528%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/filters/trade-size~48-72/
2026-01-04 10:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rubber-sheets/material~rubber-1/material~buna-n-vinyl-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000012074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=locks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:48 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152090%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4590&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finger-cots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:50 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000034528%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4665&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/coverage~finger/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:53 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000012074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4685&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11125A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211125A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=info/delivery&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-sheets/material~rubber/material~buna-n-vinyl-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4820&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-chargers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4895&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finger-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/info/delivery/
2026-01-04 10:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33384 pages (at 50 pages/min), scraped 733 items (at 1 items/min)
2026-01-04 10:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9959756966201&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9959756966201%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531217%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fingerstock-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11125A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211125A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockset-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000125075%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8615K81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228615K81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4820&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:28 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000125075%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-4895&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-59675&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11125A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211125A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/keying~without-lock-cylinder&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-97473&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-activated-adhesives/manufacturer~loctite/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5190&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-extinguisher-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation-hanging-welders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=locks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-extinguisher-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000054561%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11125A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211125A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-lite-tak-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000054561%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-5190&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:40:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~32-m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation-testers-with-nist-certificate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-thread-measuring-kits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=logging-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33434 pages (at 50 pages/min), scraped 734 items (at 1 items/min)
2026-01-04 10:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=long-allen-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~9-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~32-m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loto-(lockout-tagout)-lockouts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation-testers-with-nist-certificate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loop-to-loop-lanyards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipe-thread-measuring-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipetites/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002892653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipettes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~9-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:39 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002892653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~32-m&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iron-acme-wing-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/rulers/length~9-ft-/
2026-01-04 10:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulon-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipetites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-resistant-coveralls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pipettes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-8770&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-resistant-safes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-acme-wing-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-retardant-silicone-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulon-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33481 pages (at 47 pages/min), scraped 734 items (at 0 items/min)
2026-01-04 10:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pivot-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pivot-leveling-mounts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~1-6000-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:16 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000087808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~0-8770&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/j-knives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-use-on~press-fit-assemblies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039328%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929850%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jackson-head-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pivot-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pivot-leveling-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:33 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039328%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~1-6000-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~16-5000-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=j-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plain-bearings/ultra-low-friction-dry-running-sleeve-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/oil-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plain-bearings/ultra-low-friction-dry-running-sleeve-bearings/
2026-01-04 10:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/s-0518-1-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/firefighters-axes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackson-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jet-pallet-truck-replacement-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fire-stops/fire-stop-type~cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%225479482071661%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:41:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-diameter~16-5000-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jewelers-slotting-saw-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-operation~hand/reamer-type~for-deburring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3652365606076&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fire%20stops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3652365606076%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937284%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=s-0518-1-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-barbed-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=firefighters%27-axes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jet-pallet-truck-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33527 pages (at 46 pages/min), scraped 734 items (at 0 items/min)
2026-01-04 10:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003521793%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003457996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/shank-type~l-handle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jewelers%27-slotting-saw-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003521793%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003457996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/reamer-operation~hand/reamer-type~for-deburring&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3652365606076&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fire%20stops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3652365606076%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937284%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jig-feet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-barbed-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machinable-plastics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002128079%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/shank-type~l-handle&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fish-tape-leaders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machinable-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fish-tape-pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3652365606076&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fire%20stops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3652365606076%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937284%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jig-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-bonding-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reamers/system-of-measurement~inch/reamer-operation~hand&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sae-15w-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricant-analysis-kits/for-testing~hydraulic-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5781696663338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reamers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5781696663338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003521793%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/oil/sae-viscosity-grade~5w-30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-bumpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3652365606076&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fire%20stops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3652365606076%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937284%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/k-cups/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-bonding-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9976959188459&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricant%20analysis%20kits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9976959188459%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002067314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-key-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/kernmantle-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33576 pages (at 49 pages/min), scraped 735 items (at 1 items/min)
2026-01-04 10:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-15w-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-5w-30-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-bumpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=k-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-coated-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-cutting-circular-saw-blades/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=receiver-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kernmantle-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/kick-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fixture-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lapping-paste-lubricants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-coated-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flag-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/u-s-state-territory~illinois/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=recessed-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kick-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/lubricants-for-diamond-lapping-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knife-files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rectangular-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rectangular-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flags/state-us-territory~illinois&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/l-handle-torque-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnifiers/magnification~3-5x&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%221106986019683%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33624 pages (at 48 pages/min), scraped 735 items (at 0 items/min)
2026-01-04 10:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/thickener~polyurea&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flags/state-us-territory~illinois/
2026-01-04 10:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9673273568857&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=magnifiers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9673273568857%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081206%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4776A18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224776A18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knife-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002073797%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~kool-mist-formula-78&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/laboratory-lifts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=l-handle-torque-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6611N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226611N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-line/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2303N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222303N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085567%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~krytox-xht-bdx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flags/u-s-state-territory~tennessee&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laboratory-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140084%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9755626796405&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flags&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9755626796405%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122414%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flame-resistant-hoods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/laboratory-turrets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-mobile-shelving/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-line&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=recycling-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flame-resistant-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:44:58 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9755626796405&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flags&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9755626796405%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122414%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flags/u-s-state-territory~tennessee&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sample-tags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ladder-levelers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laboratory-turrets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-mobile-shelving&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33674 pages (at 50 pages/min), scraped 739 items (at 4 items/min)
2026-01-04 10:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~mobil-shc-625&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/laminate-workbench-tops/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flange-aligners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/fitting-connection~compression-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/fitting-type~connector-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sample-tags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-recessed-bumpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361986%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001919498%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/for-use-with~chemicals-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=laminate-workbench-tops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~molykote-dx-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002105331%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-recessed-bumpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~slick-50-onelube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~chemicals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~tap-magic-protap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~methane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reducers/for-use-with~chemicals/
2026-01-04 10:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/for-use-with~mineral-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lapping-paper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11785K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211785K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123793%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33726 pages (at 52 pages/min), scraped 739 items (at 0 items/min)
2026-01-04 10:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lapping-sticks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965661%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mechanical-jack-lifts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123793%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/trade-name~tap-magic-protap&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:46:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/color~green-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7951A17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227951A17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lapping-paper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11785K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211785K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lapping-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubrication-manifolds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mending-braces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/color~green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7951A17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227951A17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11785K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211785K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=luer-lock-dispensing-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plastic-sheets/color~green/
2026-01-04 10:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/environment~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mesh&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002050980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lathe-tool-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7951A17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227951A17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/pipe-size~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11785K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211785K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33776 pages (at 50 pages/min), scraped 739 items (at 0 items/min)
2026-01-04 10:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000115106%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanitary-heaters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-partition-trim-shoes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/performance-properties~food-contact&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-braids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathe-tool-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7951A17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227951A17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plastic-sheets/performance-properties~food-contact/
2026-01-04 10:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~1-1-2-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanitary-reducers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-heaters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-partition-trim-shoes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lead-benders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machinable-shaft-couplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-cages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=92335A115&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2292335A115%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-component-knobs/material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-reducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/thickness~0-21/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1890601580204&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20component%20knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1890601580204%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lead-benders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~7-8-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33826 pages (at 50 pages/min), scraped 740 items (at 1 items/min)
2026-01-04 10:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/reducers/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~9-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-sheets/thickness~0-21&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~fuel-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1890601580204&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20component%20knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1890601580204%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000060837%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5968784707760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5968784707760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001462130%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~m12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~nitric-acid-10-concentration&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2761N38&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222761N38%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1890601580204&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20component%20knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1890601580204%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/reducers/thread-size~m12/
2026-01-04 10:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:48:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~m2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-sheets/thickness~4-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/led-starters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6826K371&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226826K371%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~phosphoric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducers/thread-size~m5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms35206-219/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1890601580204&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20component%20knobs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1890601580204%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/left-hand-deburring-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screw-hex-nuts/material~polypropylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981614637306&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=reducers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981614637306%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33874 pages (at 48 pages/min), scraped 742 items (at 2 items/min)
2026-01-04 10:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=led-starters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=855926911775&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20screw%20hex%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B855926911775%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5352N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225352N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screws/military-specifications-met~ms35206-219&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lens-cleaning-towelettes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=855926911775&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=machine%20screw%20hex%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B855926911775%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screw-hex-nuts/material~polypropylene&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 10:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reducing-butt-splices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/shape~cross&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/machine-screws/military-specifications-met~ms35206-219/
2026-01-04 10:49:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/specifications-met~asme-standard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-storage-pails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/level-cases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/specifications-met~asme-standard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-screws/military-specification~ms51957-84/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-strap-hinges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lens-cleaning-towelettes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/level-transducers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flanges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4518K241&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224518K241%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/specifications-met~asme&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-storage-pails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=level-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-screws/specifications-met~ms51957-84&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-strap-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flanges/specifications-met~asme/
2026-01-04 10:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-tamper-evident-security-seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=level-transducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/machine-screws/specifications-met~ms51957-84/
2026-01-04 10:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lift-rite-pallet-truck-replacement-parts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33919 pages (at 45 pages/min), scraped 744 items (at 2 items/min)
2026-01-04 10:50:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lift-rite-truck-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lift-truck-seats/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-shoulder-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-rulers/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=refractory-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plastic-tamper-evident-security-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lift-rite-pallet-truck-replacement-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lift-rite-truck-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=made-to-order-lanyards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flared-fittings/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lift-truck-seats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-yor-lok-tube-to-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-tape-rulers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulb-heaters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulb-receptacles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulb-testers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micro-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flared-fittings/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-air-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flared-fittings/material~plastic/
2026-01-04 10:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulb-heaters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-bit-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-brakes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulb-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulb-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 33968 pages (at 49 pages/min), scraped 744 items (at 0 items/min)
2026-01-04 10:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/line-starts-here-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flashlight-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/line-up-punches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/measurement-unit~kilograms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plates/material~aluminum-2/material~6063-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-cup-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=milling-heads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/regulators/for-use-with~medical-gas-blend-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=milling-machine-way-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=line-starts-here-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=line-up-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scales/scale~kilograms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plates/material~aluminum/material~6063-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/littelfuse-type-225-fuses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/littelfuse-type-idsr-fuses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/for-use-with~medical-gas-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/scales/scale~kilograms/
2026-01-04 10:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9965629998276&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9965629998276%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:51:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/regulators/for-use-with~medical-gas-blend/
2026-01-04 10:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plier-jaw-covers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/load-dampers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/littelfuse-type-l50s-fuses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=littelfuse-type-225-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=littelfuse-type-idsr-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34013 pages (at 45 pages/min), scraped 744 items (at 0 items/min)
2026-01-04 10:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-work-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screen-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetically-actuated-safety-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=load-dampers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lock-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=regulators/outlet-pipe-size~1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=littelfuse-type-l50s-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plug-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnets/magnet-grade~alnico-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7367171817318&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=regulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7367171817318%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/color~blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screen-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lock-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=41795K3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2241795K3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reinforcing-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnets/shape~u/shape~bridge/shape~horseshoe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plug-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/grade~alnico-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relay-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:52:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/magnets/grade~alnico-5/
2026-01-04 10:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/color~blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lockwire-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screw-drives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/shape~u-shape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1040952587880&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1040952587880%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34060 pages (at 47 pages/min), scraped 745 items (at 1 items/min)
2026-01-04 10:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motor-controllers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/magnets/shape~u-shape/
2026-01-04 10:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-duct-hose-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motor-switches/enclosure-rating~nema-3r&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=maintained-large-object-limit-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relays/switching-current~1-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lockwire-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-drives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6835994570726&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=motor%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6835994570726%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000120458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/relays/switching-current~11-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7088615684115&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=relays&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7088615684115%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001585294%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-prism-primers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mountable-cable-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7657K34&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227657K34%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8123N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228123N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loop-end-rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mandrels/for-use-with~pedestal-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=relays/switching-current~11a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mounted-sleeve-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-prism-primers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mounting-hardware&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4498129930775&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mandrels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4498129930775%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/relays/switching-current~11a/
2026-01-04 10:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/low-pressure-stainless-steel-unthreaded-flanges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loop-end-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/for-use-with~acetic-acid-white-vinegar&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/for-use-with~acetone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plugs/plug-connection-method~push-in/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=manifolds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984513%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34111 pages (at 51 pages/min), scraped 747 items (at 2 items/min)
2026-01-04 10:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=manifolds&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricant-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-pressure-stainless-steel-unthreaded-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-tool-pans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=release-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=muffin-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3942N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223942N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3942N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223942N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/plug-type~push-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flint-lighters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carton-staplers/power-source~manual/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricant-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plugs/plug-type~push-in/
2026-01-04 10:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plumbers-grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plumb-bobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/workbenches/top-material~wood-1/top-material~maple/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multiconductor-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plugs/type~terminal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multipole-connector-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manual-carton-staplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=removable-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:54:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/plugs/type~terminal/
2026-01-04 10:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plumbers%27-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=maple-top-workbenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=narrow-hose-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/fitting-type~repair-clamp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plungers/mount-type~thread-in/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas662c-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34159 pages (at 48 pages/min), scraped 749 items (at 2 items/min)
2026-01-04 10:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plungers/thread-size~3-8-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=repair-clamp-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/body-type~thread-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-662c-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=marine-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-moving-pry-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~blue-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=plungers/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-5-15-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=reprocessed-ptfe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=markers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002191248%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-moving-pry-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-access-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~orange-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~reflective-red-reflective-white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nibblers/for-use-on~plastic-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=markers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002193306%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=markers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196558%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/connects-to~tube-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel/hardness~rockwell-b85&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=resistance-welders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8828978490450&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nibblers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8828978490450%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34212 pages (at 53 pages/min), scraped 749 items (at 0 items/min)
2026-01-04 10:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=resistor-formers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-base-strip-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6971737856557&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nickel&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6971737856557%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002324205%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=37615A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2237615A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pneumatic-rivet-guns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/connects-to~tube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pneumatic-scrapers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirator-masks/niosh-approval-number~tc-84a-0883/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9219809646750&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9219809646750%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924795%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/finish~nickel-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-base-strip-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nipples/connects-to~tube/
2026-01-04 10:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-dial-indicators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~t8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-rivet-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pneumatic-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirator-masks/niosh-approval~tc-84a-0883&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~hydraulic-fluid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-mats/mat-type~entrance&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-dial-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/respirator-masks/niosh-approval~tc-84a-0883/
2026-01-04 10:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~t8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masks/respirator-filter-rating~n100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pocket-scissors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3911241974115&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=floor%20mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3911241974115%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974226%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/snips/performance~nonsparking-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34258 pages (at 46 pages/min), scraped 750 items (at 1 items/min)
2026-01-04 10:57:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screwdrivers/size~t8/
2026-01-04 10:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-safety-decals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3028195520048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=masks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3028195520048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=62315T69&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2262315T69%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-stirrers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polarity-testers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmagnetic-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5450T28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225450T28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pole-auger-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pocket-scissors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonsparking-tin-snips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-stirrers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polarity-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pole-jacks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~1-1-2-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pole-auger-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mailbox-pedestals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pole-climbing-spikes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-and-level-control&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/maintained-toggle-pilot-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pole-jacks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-1-2-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mats/for-use-with~carpet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/manufacturer-model-number~6001&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-and-level-control&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mailbox-pedestals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/maintenance-bolt-assortments/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34305 pages (at 47 pages/min), scraped 752 items (at 2 items/min)
2026-01-04 10:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1629427390652&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mats&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1629427390652%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984368%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/manufacturer-model-number~60921&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-and-level-control&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=maintained-toggle-pilot-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/makita-compatible-staples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114896%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-and-level-control&srchtxt=&mixedworld=force&workstationdata=true> (failed 3 times): 500 Internal Server Error
2026-01-04 10:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:25 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <500 https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-and-level-control&srchtxt=&mixedworld=force&workstationdata=true>: HTTP status code is not handled or not allowed
2026-01-04 10:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polishing-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=maintenance-bolt-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5834T22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225834T22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~2-4-1-2-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=makita-compatible-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/manufacturer-model-number~75scp100l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-controls/fitting-connection~quick-disconnect&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=respirators/niosh-approval~tc-23c-3088&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polishing-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~3-4-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118791%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20controls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002364704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polycarbonate-l-channels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~2-4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/respirators/niosh-approval~tc-23c-3088/
2026-01-04 10:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~4-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5541T49&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225541T49%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screws/thread-size~2-4-1-2/
2026-01-04 10:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-controls/for-use-with~lp-gas-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~3-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polycarbonate-l-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9152409968949&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=respirators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9152409968949%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002126980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 10:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34353 pages (at 48 pages/min), scraped 754 items (at 2 items/min)
2026-01-04 10:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rest-on-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/nut-type~locknut/thread-type~unf-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=medium-prefocus-single-contact-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-controls/for-use-with~lp-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=megger-insulation-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=99030A075&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2299030A075%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/screws/thread-size~5-16-24/
2026-01-04 10:59:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/flow-controls/for-use-with~lp-gas/
2026-01-04 10:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-type~unf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~m20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyester-fabric-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyester-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=menstrual-hygiene-disposal-bag-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retaining-ring-pliers/tip-type~fixed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8956981587352&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=retaining%20ring%20pliers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8956981587352%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002250905%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 10:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retaining-rings/retaining-ring-type~external&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~m20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester-fabric-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyester-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8956981587352&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=retaining%20ring%20pliers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8956981587352%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002250905%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retaining-ring-pliers/tip-type~fixed&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:00:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6646950986674&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=retaining%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6646950986674%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002000871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34402 pages (at 49 pages/min), scraped 755 items (at 1 items/min)
2026-01-04 11:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~3-4-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~150-150&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453900%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyethylene-blanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~168-168&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mesh&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002057601%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retaining-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~230-230&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A411&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A411%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mesh&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002049585%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=85385T104&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2285385T104%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractable-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mesh&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002067624%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyethylene-blanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9318T46&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229318T46%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=retractable-key-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=85385T111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2285385T111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seal-crimpers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylock-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-switches/environment~submersible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-switches/ul-file-number~e31926&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~61-61&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/formulation~buna-n/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34454 pages (at 52 pages/min), scraped 759 items (at 4 items/min)
2026-01-04 11:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seal-crimpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh/mesh-size~86-86&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mesh&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002057656%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-mesh-abrasive-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004186169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-transmitters/flow-measurement-type~ultrasonic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3985461849490&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mesh&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3985461849490%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9318T45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229318T45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/formulation~buna-n&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:29 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004186169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-switches/ul-file-number~e31926&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-valves/valve-type~ball/fitting-connection~threaded-union/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=return-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93185T24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293185T24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mesh-wrap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5845522290168&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5845522290168%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003702172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/formulation~cellulose-nitrate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9318T45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229318T45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/connection-style~threaded-union&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-ring-pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-valves/valve-type~ball/for-use-with~hydraulic-fluid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93185T24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293185T24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/formulation~nitrocellulose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-cutting-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34503 pages (at 49 pages/min), scraped 759 items (at 0 items/min)
2026-01-04 11:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyolefin-blanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sealants/formulation~nitrocellulose/
2026-01-04 11:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9318T45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229318T45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/for-use-with~hydraulic-fluid-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93185T24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293185T24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-detectable-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8779931053344&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8779931053344%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyolefin-blanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9318T45&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229318T45%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~10120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5845522290168&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5845522290168%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003702172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132893%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-detectable-uhmw-polyethylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93185T24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293185T24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:02:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~10760/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-duct-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~2084/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rg-58%252fu-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~10120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~220&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5845522290168&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5845522290168%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003702172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~10760&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151505%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rg-6-u-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000088384%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/for-use-with~benzene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~2084&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-style~ribe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143061%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34555 pages (at 52 pages/min), scraped 759 items (at 0 items/min)
2026-01-04 11:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967302%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5845522290168&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=flow%20transmitters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5845522290168%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003702172%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111569%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~3104/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/for-use-with~fluorinated-solvents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/o-rings/hardness-rating~extra-hard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=methanol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7432A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227432A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ribe-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179263%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~4475/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=offset-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~3104&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/hardness~extra-hard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ridgid-96725-metal-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-keyway-broaches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/polyurethane-air-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081250%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/o-rings/hardness~extra-hard/
2026-01-04 11:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~4475&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-absorbents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74545A27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274545A27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=right-angle-gear-drives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089237%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=polyurethane-air-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluorescent-ballasts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-stainless-steel-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34606 pages (at 51 pages/min), scraped 761 items (at 2 items/min)
2026-01-04 11:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75285A65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275285A65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-jugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-sandwich-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~594/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-wing-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/u-s-state-territory~michigan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/popcorn/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~594&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=micro-limit-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=michigan-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ring-gauges/pipe-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132399%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pop-rivets/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=microfiber-cloths&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=on-off-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=popcorn&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slings/number-of-legs~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5131635916106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ring%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5131635916106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000086699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74945A67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274945A67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:04:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pop-rivets/material~stainless-steel/
2026-01-04 11:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~795/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~8019/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2121A137&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222121A137%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/portable-scales/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34652 pages (at 46 pages/min), scraped 763 items (at 2 items/min)
2026-01-04 11:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~dp640/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=one-leg-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/positioning-bases/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=open-roller-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~795&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~8019&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlet-strip-extension-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2121A137&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222121A137%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=portable-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~dp640&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143555%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=positioning-bases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~rtv162/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74885A23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274885A23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outside-micrometers/manufacturer~mitutoyo&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/manufacturer-model-number~tl42/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2121A137&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222121A137%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7467A78&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227467A78%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-socket-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8260587697623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outside%20micrometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8260587697623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244689%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~rtv162&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fractional-horsepower-v-belts/belt-trade-size~5l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~tl42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2121A137&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222121A137%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34703 pages (at 51 pages/min), scraped 765 items (at 2 items/min)
2026-01-04 11:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-gun-gas-diffusers/manufacturer-model-number~magnum-200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8724285462245&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fractional%20horsepower%20v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8724285462245%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002004176%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/potentiometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-gun-gas-diffusers/manufacturer-model-number~magnum-400&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7095521672345&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mig%20gun%20gas%20diffusers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7095521672345%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321516%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivet-nuts/finish~zinc-yellow-chromate-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivet-nuts/thread-size~1-4-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7095521672345&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mig%20gun%20gas%20diffusers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7095521672345%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002320692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7862604308299&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivet%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7862604308299%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547790%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-gun-nozzles/manufacturer-model-number~m-100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7862604308299&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivet%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7862604308299%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/powder-coating-strippers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=potentiometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95105A111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295105A111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9740843502878&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mig%20gun%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9740843502878%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004784409%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~masonry/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foil-scrim-kraft-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~plastic-1/for-use-on~polystyrene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=powder-coating-strippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing-tape-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=riveted-ball-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~masonry&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141182%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~stone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34753 pages (at 50 pages/min), scraped 766 items (at 1 items/min)
2026-01-04 11:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~polystyrene-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pad-eyes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-guns/for-manufacturer~lincoln&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sealers/for-use-on~polystyrene-plastic/
2026-01-04 11:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4649057477769&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mig%20guns&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4649057477769%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123093%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/material~rubber-1/material~buna-n-cork&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/manufacturer~devcon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealing-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~stone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanized-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-spool-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930162%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mig-welding-liners/manufacturer-model-number~m-100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951811382783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951811382783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164949%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/material~rubber-1/material~buna-n-cork&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/manufacturer~devcon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1643606697087&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mig%20welding%20liners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1643606697087%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004784409%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=garden-hose-fittings/thread-type~nh-nst&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mil-g-3036-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002263064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4332774955340&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=garden%20hose%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4332774955340%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-removers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gas-shut-off-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34804 pages (at 51 pages/min), scraped 766 items (at 0 items/min)
2026-01-04 11:08:12 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002263064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/manufacturer~devcon&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6494T22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226494T22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~45-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/output-voltage~12v-dc-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-shrouds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:22 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/diameter~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/fastener-head-type~flat/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/peel-type-blind-rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000042501%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/external-power-supply-efficiency-standard~doe-level-vi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~45mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/output-voltage~12v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/power-supplies/specifications-met~semi-f47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/material~brass-1/fastener-head-type~domed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=97525A239&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2297525A239%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/head-type~flat&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivets/high-strength-blind-rivets-for-soft-materials&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/seals/for-shaft-diameter~45mm/
2026-01-04 11:08:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/power-supplies/output-voltage~12v-dc/
2026-01-04 11:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510572%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001585070%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rivets/head-type~flat/
2026-01-04 11:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=power-supplies/specifications-met~doe-level-vi-efficiency&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7107088629157&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rivets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7107088629157%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%227119421988808%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90217A610&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290217A610%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/for-use-with~liquid-ammonia/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/thickness~6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/power-supplies/specifications-met~doe-level-vi-efficiency/
2026-01-04 11:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=93372A290&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2293372A290%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-hole-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/powered-conveyor-rollers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34851 pages (at 47 pages/min), scraped 769 items (at 3 items/min)
2026-01-04 11:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/for-use-with~natural-gas-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~liquid-ammonia&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/width~0-053&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/precision-acme-platform-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paper/for-use-on~copper-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=powered-conveyor-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gaskets/thickness~6mm/
2026-01-04 11:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/precision-adjustment-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000076766%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/for-use-on~copper-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~natural-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-acme-platform-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992232473973&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992232473973%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930214%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/precision-extension-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/for-use-on~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/seals/for-use-with~natural-gas/
2026-01-04 11:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/for-use-with~natural-gas-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paper/for-use-on~titanium-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:09:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/paper/for-use-on~copper/
2026-01-04 11:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/maximum-pressure~1200-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992232473973&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992232473973%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930487%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=precision-extension-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/for-use-with~natural-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivnuts/rivet-nut-body-shape~hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34895 pages (at 44 pages/min), scraped 770 items (at 1 items/min)
2026-01-04 11:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miniature-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parts-baskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/maximum-pressure-psi~1200-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/for-use-with~natural-gas/
2026-01-04 11:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/seals/material~stainless-steel/
2026-01-04 11:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/system-of-measurement~letter-size/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/security-sheet-metal-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001715388%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sheets/material~borosilicate-glass/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rivnuts/body-type~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/system-of-measurement~letter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-and-ceramic-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rl223a-1-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mirrors/mount-type~hanging&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=security-sheet-metal-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rivnuts/body-type~hex/
2026-01-04 11:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass/borosilicate-glass-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=miter-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/coating-material~buna-n&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/system-of-measurement~letter/
2026-01-04 11:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6828105263257&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mirrors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6828105263257%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011113%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~1200-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:10:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/glass/borosilicate-glass-sheets/
2026-01-04 11:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097171%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/for-use-on~glass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6828105263257&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mirrors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6828105263257%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011113%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mirrors/mount-type~hanging&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~3-5-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/color~gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34945 pages (at 50 pages/min), scraped 770 items (at 0 items/min)
2026-01-04 11:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-bases-for-collaborative-robot-arms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~1200-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/maximum-pressure~6000-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/for-use-with~ethyl-acetate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mixers/for-use-with~mineral-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~glass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=forklift-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~3-5-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001715388%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8018988495419&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mixers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8018988495419%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967510%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8018988495419&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mixers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8018988495419%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/glue/for-use-on~glass/
2026-01-04 11:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7534361604797&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7534361604797%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001747782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-gauges/maximum-pressure-psi~6000-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=forklift-mount-floor-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/pressure-gauges/maximum-pressure-psi~6000-psi/
2026-01-04 11:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pin-connectors/number-of-poles~8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=piloted-spot-facers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-gauges/measurement-unit~kilopascals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-safety-padding/for-robot-arm-manufacturer-model-number~20ia-l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-1045-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobil-delvac-1230-diesel-engine-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/series-815-conveyor-belts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9993803950476&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20safety%20padding&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9993803950476%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005276579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-connectors/number-of-poles~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobil-delvac-1300-super-diesel-engine-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pin-connectors/number-of-poles~8/
2026-01-04 11:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 34998 pages (at 53 pages/min), scraped 770 items (at 0 items/min)
2026-01-04 11:12:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=formaldehyde-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=series-815-conveyor-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-2h-steel-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-test-points/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-safety-padding/for-robot-arm-manufacturer-series~rv&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-plungers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobil-vactra-no-2-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-teach-pendant-cord-reels/cord-manufacturer-equivalent-model-number~xgmf12573&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9993803950476&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20safety%20padding&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9993803950476%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095489%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pressure-washer-wands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-test-points&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2260525566009&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20teach%20pendant%20cord%20reels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2260525566009%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140964%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/color~tan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foxtail-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobile-floor-cranes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robot-teach-pendant-cords/manufacturer-equivalent-model-number~156798-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/for-use-on~cast-iron/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/for-use-on~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3821N104&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223821N104%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pressure-washer-wands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3733552981249&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robot%20teach%20pendant%20cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3733552981249%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005187456%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/for-use-on~plastic-1/for-use-on~pvc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/primers/manufacturer~dow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/color~tan&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3822N123&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223822N123%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~cast-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~leather&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sf-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/struts/strut-channel-framing-component~trolley/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7559498251638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7559498251638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548474%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/shape~hat-channel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35046 pages (at 48 pages/min), scraped 772 items (at 2 items/min)
2026-01-04 11:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shackles/thickness~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7559498251638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7559498251638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/primers/for-use-on~leather/
2026-01-04 11:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/manufacturer~dow-corning&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971113029698&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=framing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971113029698%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=primers/for-use-on~pvc-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shackles/thickness~1-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sf-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/primers/manufacturer~dow-corning/
2026-01-04 11:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/strut-channel-trolleys-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/primers/for-use-on~pvc-plastic/
2026-01-04 11:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shackles/thickness~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/framing/strut-channel-trolleys-5/
2026-01-04 11:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/robotics/robot-cell-component~cover/for-robot-arm-manufacturer~yaskawa-motoman/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/nlgi-consistency-grade~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9493236633548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9493236633548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001454080%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shackles/thickness~1-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~dri-slide-ep-liquid-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~compensation-device/for-robot-arm-manufacturer~staubli&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003076841%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~gripper/for-robot-arm-manufacturer~doosan&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9493236633548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9493236633548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001461693%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=monel-safety-lock-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robotics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123607%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247979%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~tool-mount/manufacturer~fanuc/manufacturer-series~crx&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~cover/manufacturer~yaskawa-motoman&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robotics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142085%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002276117%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6190N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226190N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robotics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002102433%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002259996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robotics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401586%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35096 pages (at 50 pages/min), scraped 772 items (at 0 items/min)
2026-01-04 11:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3767N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223767N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=freezer-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mop-pails/material~plastic-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics/robot-cell-component~vacuum-lifter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=robotics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-020/diameter~0-02/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8431001172163&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=mop%20pails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8431001172163%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000064886%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grips/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985525866263&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=robotics&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985525866263%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096768%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rock-salt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=friction-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-alignment-couplers/system-of-measurement~inch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/material~rubber-1/material~silicone-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-02inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-101/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/motors/motor-enclosure-type~open-dripproof-odp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3106802242081&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rod%20alignment%20couplers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3106802242081%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498016%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/guards/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grips/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:14:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-02inches/
2026-01-04 11:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/material~rubber/material~silicone-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grips/material~bronze/
2026-01-04 11:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motors/motor-frame-size~nema-56&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-101inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35143 pages (at 47 pages/min), scraped 774 items (at 2 items/min)
2026-01-04 11:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=motors/motor-enclosure-type~open-dripproof-odp-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rail-carriages/carriage-width~126-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guards/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1732707636827&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grommets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1732707636827%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mountable-wire-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9884332045743&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9884332045743%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001573965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-101inches/
2026-01-04 11:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fume-exhausters/environment~hazardous&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/motors/motor-enclosure-type~open-dripproof-odp-/
2026-01-04 11:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000152994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/guards/material~iron/
2026-01-04 11:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-ends/shank-thread-size~5-8-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4571381093736&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fume%20exhausters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4571381093736%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000137394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-1719/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6709K108&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226709K108%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=20-watt-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-187/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8204790604356&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rod%20ends&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8204790604356%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000056749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-ends/shank-thread-size~7-16-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-ends/shank-thread-size~8-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rod-ends/shank-thread-size~m4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6071K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226071K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8204790604356&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rod%20ends&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8204790604356%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-1719inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-246/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-187inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8204790604356&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rod%20ends&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8204790604356%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8204790604356&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rod%20ends&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8204790604356%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000108800%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-1719inches/
2026-01-04 11:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-122121-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-187inches/
2026-01-04 11:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=60645K98&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2260645K98%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=59935K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2259935K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-4-1/diameter~0-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6071K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226071K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35193 pages (at 50 pages/min), scraped 775 items (at 1 items/min)
2026-01-04 11:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rail-carriages/carriage-width~63-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-246inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-246inches/
2026-01-04 11:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000005821%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-011&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handles/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-124655-helical-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-6563/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-25inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6071K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226071K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3%252f8%22-square-drive-impact-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-25inches/
2026-01-04 11:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-15795-814-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-6563inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3%252f8%22-square-drive-impact-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6071K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226071K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000005821%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/handles/material~brass/
2026-01-04 11:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-11&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:16:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~0-6563inches/
2026-01-04 11:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3%252f8%22-square-drive-impact-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=30-watt-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-05-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~1000-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3%252f8%22-square-drive-impact-wrenches&srchtxt=&mixedworld=force&workstationdata=true> (failed 3 times): 500 Internal Server Error
2026-01-04 11:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001539669%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:07 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <500 https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3%252f8%22-square-drive-impact-wrenches&srchtxt=&mixedworld=force&workstationdata=true>: HTTP status code is not handled or not allowed
2026-01-04 11:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35242 pages (at 49 pages/min), scraped 777 items (at 2 items/min)
2026-01-04 11:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001513692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000005821%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A248&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A248%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hdpe-rod-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~312/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-05millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-1563&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~1-05millimeters/
2026-01-04 11:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~317/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000005821%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:17:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547400%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-55millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16996-15-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A221&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A221%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~14-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-213&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=317-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~1-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~1-55millimeters/
2026-01-04 11:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-2656&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=360-watt-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529185%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hex%20drivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489790%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001557514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rivets/military-specification~ms20426ad5-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~32-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~14-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A213&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A213%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16997-66-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35292 pages (at 50 pages/min), scraped 779 items (at 2 items/min)
2026-01-04 11:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A128&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A128%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-16997-80-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/drive-size~14-mm-1/
2026-01-04 11:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-20426-ad5-5-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/drive-size~32-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A213&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A213%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~0-9063&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~20inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A128&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A128%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/drive-size~32-mm-1/
2026-01-04 11:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-21043-06-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~20inches/
2026-01-04 11:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-21043-5-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A213&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A213%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~3-85-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A128&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A128%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/color~purple-to-clear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:18:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/3d-printer-filaments/color~purple-to-clear/
2026-01-04 11:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000164992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A213&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A213%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-3125/diameter~1-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~3-85millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A128&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A128%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~1-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35346 pages (at 54 pages/min), scraped 779 items (at 0 items/min)
2026-01-04 11:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-417&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~3-85millimeters/
2026-01-04 11:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~1-7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-filaments/material~abs-polycarbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~17-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533705%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~1-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8230254771998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20filaments&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8230254771998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530644%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2391N21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222391N21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~1-7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~1-5mm/
2026-01-04 11:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/voltage~80v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3665N15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223665N15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~17-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~1-7-8/
2026-01-04 11:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~17-32/
2026-01-04 11:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553709%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~7-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/size~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c10-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~12-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:19:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~2-1-8/
2026-01-04 11:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~9-4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~9-3-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hex-drivers/size~2-1-4/
2026-01-04 11:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c270-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525883%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35393 pages (at 47 pages/min), scraped 781 items (at 2 items/min)
2026-01-04 11:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~7-5inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/drive-size~47-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553709%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~9-4millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~9-3millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c54-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~7-5inches/
2026-01-04 11:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~2-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-24693-c8-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~9-4millimeters/
2026-01-04 11:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/diameter~9-3millimeters/
2026-01-04 11:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553709%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-1-2-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanized-steel-vents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-1-2-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanizing-paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-5-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~2-1-2-1/
2026-01-04 11:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3d-printer-resins/flexibility~rigid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~2-800-mm/diameter~2-8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:20:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8931638457760&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=fuses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8931638457760%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553709%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:20:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-1-2-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~3l180/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-4-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5304452195484&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=3d%20printer%20resins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5304452195484%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000096204%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-7-8-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531158%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524446%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35441 pages (at 48 pages/min), scraped 781 items (at 0 items/min)
2026-01-04 11:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95090A507&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295090A507%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7482N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227482N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A252&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A252%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A415&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A415%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~3-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3l180-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-4-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-7-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000169380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000013040%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95090A507&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295090A507%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7482N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227482N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shafts/thread-size~1-7-8-8/
2026-01-04 11:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~3-8-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35335-57-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-35333-71-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95090A507&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295090A507%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-pipe-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~3-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-1300l-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7482N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227482N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~4-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~1-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51023-52-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35490 pages (at 49 pages/min), scraped 782 items (at 1 items/min)
2026-01-04 11:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95090A507&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295090A507%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127341%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K113&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K113%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7482N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227482N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~4-55mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51575-15-shoulder-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-dp-604ns-adhesive-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shears/for-cutting~webbing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~5-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=3m-dp-605ns-adhesive-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~4-55mm/
2026-01-04 11:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~7-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127341%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gas-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shears/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/diameter~6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shears/for-cutting~webbing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~5-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~7-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-use-on~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5847281553902&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5847281553902%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929633%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:22:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-hole-diameter~5-32/
2026-01-04 11:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127341%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/diameter~2-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shears/for-use-on~wood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-punches/for-hole-diameter~7-64/
2026-01-04 11:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/diameter~6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3430402569734&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20punches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3430402569734%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929691%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shears/for-use-on~wood/
2026-01-04 11:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35538 pages (at 48 pages/min), scraped 783 items (at 1 items/min)
2026-01-04 11:23:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/diameter~6mm/
2026-01-04 11:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000053987%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hinges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127341%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shelving/component~shelf-bracket/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~460j8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shielded-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~2-1-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51960-63-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/material~glass-filled-nylon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-saws/diameter~2-1-4-1/
2026-01-04 11:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/diameter~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shelving/component~shelf-bracket&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/specifications-met~california-ab1953&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=460j8-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shielded-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shields/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1173010037349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hole%20saws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1173010037349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001555549%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rods/thread-size~1-1-8-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8128528462812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8128528462812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002257015%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094582%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-51967-2-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4066A75&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224066A75%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-saws/for-use-on~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3588N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223588N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shields/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rods/thread-size~1-1-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shields/performance-properties~high-voltage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shields/material~brass/
2026-01-04 11:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35588 pages (at 50 pages/min), scraped 786 items (at 3 items/min)
2026-01-04 11:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=msds-document-stations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rods/thread-size~1-1-8-8/
2026-01-04 11:24:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shields/performance-properties~high-voltage/
2026-01-04 11:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-saws/for-use-on~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multi-angle-drill-heads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gasket-tape/certification~ul-recognized-component&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~4l680/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hole-saws/for-use-on~stainless-steel/
2026-01-04 11:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-and-loop-straps/mount-type~adhesive-back&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/color-coded-shims/sold-as~assortment/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multi-leg-chain-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9533446928495&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gasket%20tape&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9533446928495%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002256898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=multi-tool-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6020751333810&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hook%20and%20loop%20straps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6020751333810%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010855%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~4l860/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4l680-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hooks/finish~plastic-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:51 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6020751333810&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hook%20and%20loop%20straps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6020751333810%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010855%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-and-loop-straps/mount-type~adhesive-back&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/color-coded-shim-stock-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/fitting-connection~flared-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:24:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1752A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221752A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/quick-clamp-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=4l860-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/color-coded-shim-stock-sets/
2026-01-04 11:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~alcohol-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/fitting-connection~quick-disconnect/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-bonded-sealing-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35633 pages (at 45 pages/min), scraped 786 items (at 0 items/min)
2026-01-04 11:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/connection-style~flared&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/connection-style~quick-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~adhesive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/material~iron/
2026-01-04 11:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=77495A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2277495A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/connection-style~flared/
2026-01-04 11:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/fitting-connection~quick-disconnect-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/metal-bonded-sealing-washers-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/connection-style~quick-clamp/
2026-01-04 11:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~ammonia&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-caps/tig-industry-number~57y04/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984438%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ptfe-unthreaded-spacers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/fitting-connection~quick-disconnect-1/
2026-01-04 11:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/metal-bonded-sealing-washers-6/
2026-01-04 11:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shim-stock/sold-as~assortment/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965242%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5565K811&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225565K811%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-05/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-0015/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A418&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A418%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=57y04-tig-torch-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/ptfe-unthreaded-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~magnesium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:25:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hooks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001552856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:26:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/shim-stock-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/ptfe-unthreaded-spacers/
2026-01-04 11:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-05inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-0015&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/shim-stock-assortments/
2026-01-04 11:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-095/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35680 pages (at 47 pages/min), scraped 789 items (at 3 items/min)
2026-01-04 11:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-09&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-05inches/
2026-01-04 11:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=77495A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2277495A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001466859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1149-c0363r-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roll-up-curtains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505440%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-032/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roll-up-screens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-095inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1149-c0832r-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K718&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K718%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-095inches/
2026-01-04 11:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~5v560/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-115/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-39/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-032&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~toilets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-71/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001466764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352c-02-6-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494307%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967382%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=5v560-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-115&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-39inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K344&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K344%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:10 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967382%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~toilets&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-71inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35727 pages (at 47 pages/min), scraped 791 items (at 2 items/min)
2026-01-04 11:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-25mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-39inches/
2026-01-04 11:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nas1352c-6-12-socket-head-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas-1352c-02-6-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~0-71inches/
2026-01-04 11:27:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/thickness~0-25mm/
2026-01-04 11:27:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001458769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-115&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/specifications-met~fed-spec-mmm-a-121/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-and-links/roller-chain-trade-number~120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-and-links/roller-chain-trade-number~160-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-014&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1820305007632&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20and%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1820305007632%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000108594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1820305007632&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20and%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1820305007632%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-chain-and-links/roller-chain-trade-number~c2060h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=needle-nose-vise-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/specifications-met~mmm-a-121&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=natural-gas-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~6-000-mm/thickness~6-0-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464840%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1820305007632&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=roller%20chain%20and%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1820305007632%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000006491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-344&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gaskets/specifications-met~mmm-a-121/
2026-01-04 11:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1867T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221867T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/needles/needle-gauge~17/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001461536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/needles/needle-gauge~20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~16-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~11-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:09 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001461536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-344&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-conveyor-legs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35776 pages (at 49 pages/min), scraped 793 items (at 2 items/min)
2026-01-04 11:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shims/thickness~6mm/
2026-01-04 11:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~2-9/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roller-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504347%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=needles/needle-gauge~17-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=needles/needle-gauge~20-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~16millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=51185K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2251185K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/needles/needle-gauge~17-ga/
2026-01-04 11:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~3-5/id~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/needles/needle-gauge~20-ga/
2026-01-04 11:28:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose/id~16millimeters/
2026-01-04 11:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=90-degree-braces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shop-stools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=90-degree-gear-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-diameter~11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5289K28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225289K28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a-frame-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l18-30-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l22-30-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shop-stools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~9-16-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000039616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rollers/roller-material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l5-30-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~a47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35828 pages (at 52 pages/min), scraped 795 items (at 2 items/min)
2026-01-04 11:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-l7-15-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-bolts/thread-size~m6-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~1-15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a55-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~a69/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-clamps/material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:27 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rollers/roller-material~plastic/
2026-01-04 11:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a47-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074255%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5313593865679&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hose%20clamps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5313593865679%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/connectors/nema-type~ml3-15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-bolts/thread-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/hose-id~3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=a69-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5411K12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225411K12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/shoulder-bolts/thread-size~m6/
2026-01-04 11:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nema-ml3-15-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rollers/roller-width~12-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-hose-id~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=network-line-testers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasion-resistant-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-008/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2280523379316&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2280523379316%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000066295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1460T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221460T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:30:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/hose-fittings/connection-style~barbed/for-hose-id~3-4/
2026-01-04 11:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35878 pages (at 50 pages/min), scraped 796 items (at 1 items/min)
2026-01-04 11:30:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-blaster-window-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1470T615&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221470T615%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/manufacturer-model-number~516-931-26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-alloy-200-201-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-0207/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-0080&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abrasive-blasting-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-cylinders/bore-diameter~2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-gear-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-0080/
2026-01-04 11:30:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5171308755878&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hydraulic%20cylinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5171308755878%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-044/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-044/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-0207&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-047/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-reservoirs/oil-outlet-pipe-size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-0207/
2026-01-04 11:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7305746640836&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hydraulic%20reservoirs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7305746640836%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-044&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-0440&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=abs-cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-047&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:05 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7305746640836&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hydraulic%20reservoirs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7305746640836%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-reservoirs/oil-outlet-pipe-size~1-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:31:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-044/
2026-01-04 11:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~carbon-dioxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-0440/
2026-01-04 11:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35928 pages (at 50 pages/min), scraped 797 items (at 1 items/min)
2026-01-04 11:31:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-047/
2026-01-04 11:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~ethane-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/for-use-with~oxygen-blend/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicon-carbide-grinding-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nipples/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=absolute-pressure-transducers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inline-fuel-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A312&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A312%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~lubricant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7393476033006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauge%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7393476033006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080822%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:31:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ac-servomotors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/for-use-with~oxygen-mixtures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicon-carbide-grinding-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984502%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nipples/for-use-with~oxygen-mixtures/
2026-01-04 11:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-143/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nipples/material~fiberglass/
2026-01-04 11:31:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~0-146/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicone-masking-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3360N304&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223360N304%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicone-rubber-angles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicone-rubber-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nipples/thread-size~1-4-28-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-1430&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=accumulator-chargers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 35974 pages (at 46 pages/min), scraped 799 items (at 2 items/min)
2026-01-04 11:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~0-1460&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334548%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-masking-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-rubber-angles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-1430/
2026-01-04 11:32:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-rubber-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~0-1460/
2026-01-04 11:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~npl-20-ht&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauge-blocks/gauge-size~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silver-and-deming-drill-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982017210813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nipples&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982017210813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roof-drain-grates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-homopolymer-round-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~sc-210&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauge-blocks/size~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silver-and-deming-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=roof-sealers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111936%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:32:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauge-blocks/size~8/
2026-01-04 11:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~sc-28&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-length-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetal-rounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002120509%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~schb-31&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-engine-idling-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36026 pages (at 52 pages/min), scraped 799 items (at 0 items/min)
2026-01-04 11:33:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=acetate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111936%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope/diameter~0-06&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139670%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=no-ux-1-clipper-belt-lacing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/continuous-length-measurers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7090012887875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rope&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7090012887875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001535587%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111936%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/continuous-length-measurers/
2026-01-04 11:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~sfc-23&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8936T63&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228936T63%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~sft-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~sft-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/for-use-with~ketone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111382%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmagnetic-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969190%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111936%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/for-use-with~propylene-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3712K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223712K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/awls/performance~nonsparking-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~st-20-ht&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/maximum-pressure~15000-psi-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7897A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227897A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36079 pages (at 53 pages/min), scraped 801 items (at 2 items/min)
2026-01-04 11:34:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonsparking-ball-peen-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122260%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonsparking-awls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sleeve-bearing-blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sleeve-bearing-carriages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonsparking-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sleeves/material~iron-copper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonsparking-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonsparking-scratch-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:34:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002110058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeve-bearing-carriages&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeve-bearing-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sleeves/environment~food-and-beverage/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonswiveling-hoist-rings/finish~black-oxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeves/material~iron-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9886393867749&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nonswiveling%20hoist%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9886393867749%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550737%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rope-tie-downs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=299320586602&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B299320586602%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531130%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rosin&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36125 pages (at 46 pages/min), scraped 802 items (at 1 items/min)
2026-01-04 11:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ada-compliant-grab-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeves/performance-properties~food-contact&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ada-compliant-push-button&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sleeves/performance-properties~food-contact/
2026-01-04 11:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=note-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slide-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-nozzles/nozzle-type~bend-and-stay/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <POST https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 11:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~ucfl204&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:34 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <POST https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 11:35:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measurement-unit~centimeters-per-hour/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-hammers/manufacturer~bosch&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003916843%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adapters/tube-od~1-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings/for-mounted-bearing-model-number~ucp209&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slide-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/bend-and-stay-air-nozzles-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/for-use-with~propane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3566500454852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rotary%20hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3566500454852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002270406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3986711649816&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insert%20bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3986711649816%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003916861%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:35:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nozzles/bend-and-stay-air-nozzles-7/
2026-01-04 11:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9830859981210&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9830859981210%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/scale~centimeters-per-hour&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measurement-unit~centimeters-per-minute/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adapters/for-tube-od~1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9830859981210&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9830859981210%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/for-use-with~propane&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:36:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/scale~centimeters-per-hour/
2026-01-04 11:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-industry-number~10n47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36171 pages (at 46 pages/min), scraped 802 items (at 0 items/min)
2026-01-04 11:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tig-torch-nozzles/tig-industry-number~13n09/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adapters/for-tube-od~1-64/
2026-01-04 11:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/material~copper-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slot-fasteners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/slot-mills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/performance~flame-resistant-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/unit-of-measure~n-cm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/scale~cm-min&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122395%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-pipe-unions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/tig-torch-nozzles/industry-number~10n47&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nozzles/tig-torch-nozzles/industry-number~13n09&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/scale~cm-min/
2026-01-04 11:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slot-fasteners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slot-mills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nozzles/tig-torch-nozzles/industry-number~10n47/
2026-01-04 11:36:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/nozzles/tig-torch-nozzles/industry-number~13n09/
2026-01-04 11:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/system-of-measurement~cnm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/small-cell-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jackets/performance~chemical-resistant-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jackets/performance~water-resistant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/small-parts-grippers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/gauges/system-of-measurement~cnm/
2026-01-04 11:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nut-grippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/small-parts-pickup-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/color~fluorescent-yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/application~chemical-resistant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/application~water-resistant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=small-parts-grippers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jackets/color~gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=small-cell-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36220 pages (at 49 pages/min), scraped 802 items (at 0 items/min)
2026-01-04 11:37:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-tool-wheel-brushes/manufacturer-model-number~285&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/jackets/application~chemical-resistant/
2026-01-04 11:37:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/jackets/application~water-resistant/
2026-01-04 11:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001544617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=small-parts-pickup-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=insulation&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6174913493338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rotary%20tool%20wheel%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6174913493338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotary-vane-vacuum-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotating-electrical-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rotating-platforms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gear-pitch-identifiers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=kevlar-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~1045/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6174913493338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rotary%20tool%20wheel%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6174913493338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~2-1-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/snubbers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/equivalent-key-number~1045&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-belts/diameter~12-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/material~aluminum-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:05 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/nut-type~locknut/thread-size~2-1-4-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:38:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6174913493338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rotary%20tool%20wheel%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6174913493338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-belts/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9953543717325&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=jackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9953543717325%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:38:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/keys/equivalent-key-number~1045/
2026-01-04 11:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/for-use-on~rubber-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gearless-ratchet-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36275 pages (at 55 pages/min), scraped 802 items (at 0 items/min)
2026-01-04 11:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6178916986877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=round%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6178916986877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000077135%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=keys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6178916986877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=round%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6178916986877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sock-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snubbers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/finishing-plugs/shape~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6174913493338&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rotary%20tool%20wheel%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6174913493338%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321568%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:38:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6178916986877&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=round%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6178916986877%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081137%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-belts/environment~food-and-beverage&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-head-screwdriver-bits/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lags/for-use-in~blocks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sock-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-finishing-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-pins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/pem-part-number~cls-0518-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-nose-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-screwdriver-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lags/for-use-in~block&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002118410%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-seal-tags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:38:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/lags/for-use-in~block/
2026-01-04 11:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-weld-tees/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=round-stock/material~garolite-1/material-grade~garolite-g-9-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=latches/tamper-seal-tags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-312-18-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36321 pages (at 46 pages/min), scraped 802 items (at 0 items/min)
2026-01-04 11:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9966482870917&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=round%20stock&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9966482870917%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003432806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003433033%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rounded-anvil-micrometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-weld-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lcn-9140-door-openers%252fclosers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/latches/tamper-seal-tags/
2026-01-04 11:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~1-967-18-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~1-5-16-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449201%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/mats/finish~adhesive-coated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/nuts/thread-size~1-5-16-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass%252fcarbon-laminate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=router-templates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~2-933-12-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rs-232-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-mats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-removal-grinding-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-spreaders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesive-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 11:40:05 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=knives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 11:40:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/products/nuts/thread-size~1-5-16-12/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 11:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder/for-station-manufacturer-model-number~wd2000m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:06 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/products/nuts/thread-size~1-5-16-12/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 11:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36368 pages (at 47 pages/min), scraped 802 items (at 0 items/min)
2026-01-04 11:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder/shape~triangular-bar/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/for-soldering-station-manufacturer-model-number~mc5001&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~acrylic-fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-mirrors/material~glass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/solder/for-soldering-station-manufacturer-model-number~mc5001/
2026-01-04 11:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/for-soldering-station-manufacturer-model-number~wd2000m&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~brass-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=letters/backing-type~plain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930055%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/shape~round&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/thread-size~m35&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/shape~triangular-bar&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/solder/for-soldering-station-manufacturer-model-number~wd2000m/
2026-01-04 11:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930266%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985194422519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=letters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985194422519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529519%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-lavatory-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=levels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448469%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7670440523675&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7670440523675%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-run-channel-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:43 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9985194422519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=letters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9985194422519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529519%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=letters/backing-type~plain&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:49 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7670440523675&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7670440523675%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/shape~triangular-bar&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~silicone-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solderless-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/shape~concave&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solenoid-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930297%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~vinyl-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/for-use-on~titanium-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308814%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon/material-grade~nylon-6-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber/shape~ring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-drinking-water-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36420 pages (at 52 pages/min), scraped 802 items (at 0 items/min)
2026-01-04 11:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solderless-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5632811590918&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nylon&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5632811590918%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002327032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoid-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5950211940183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rubber&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5950211940183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liners/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/for-use-on~titanium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8682K81&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228682K81%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-backed-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adhesives/for-use-on~titanium/
2026-01-04 11:41:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solenoids/shape~wye/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-pipe-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liners/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/formulation~synthetic-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glides/mount-type~hammer-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/for-use-with~soluble-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-swivel-caster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvent-cans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/liners/material~aluminum/
2026-01-04 11:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5225163669291&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=adhesives&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5225163669291%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145953%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-expansion&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/shape~wye&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvents/for-use-on~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soluble-oil-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glides/mount-type~hammer-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310158%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvent-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvents/for-use-on~plastic-1/for-use-on~polyimide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36467 pages (at 47 pages/min), scraped 803 items (at 1 items/min)
2026-01-04 11:42:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/glides/mount-type~hammer-in/
2026-01-04 11:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adhesives/manufacturer~momentive/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/color~white-brown&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310158%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/shape~wye&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fitting-gaskets/material~rubber-1/environment~sanitary/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=gloves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002189074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/solvents/for-use-on~aluminum/
2026-01-04 11:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~polyimide-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-rod-end-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-493&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-angle-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adhesives/manufacturer~momentive-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7920N101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227920N101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/solvents/for-use-on~polyimide-plastic/
2026-01-04 11:42:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/adhesives/manufacturer~momentive-1/
2026-01-04 11:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-sanitary-tube-fitting-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~177&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/for-housing-id~1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000159250%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~201&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-countersinks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rubber-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:42:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-es1902&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~321&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K335&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K335%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-length-shipping-tubes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000137165%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000133170%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36522 pages (at 55 pages/min), scraped 804 items (at 1 items/min)
2026-01-04 11:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-length-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K337&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K337%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K402&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K402%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000155950%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/for-housing-id~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-lb-8023&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ruler-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~336&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~341&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124954%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-silicone-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-u-09lv&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~361&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000017604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/for-housing-id~7-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loops/material~stainless-steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~120/length~10-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000101824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982395029765&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=loops&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982395029765%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001585466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001633912%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K517&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K517%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~374&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36574 pages (at 52 pages/min), scraped 807 items (at 3 items/min)
2026-01-04 11:44:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~19-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104324%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000057639%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001629911%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001610440%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K398&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K398%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=adjustable-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001625401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~415&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:34 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001629911%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~18&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:44:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001610440%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~19-1-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~419&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/lubricant-type~dry-film/additive~graphite-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000043546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/formulation~elastomer-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~32-m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000084967%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K239&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K239%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094652%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/formulation~neoprene-cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~439&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/lubricant-type~dry-film-lubricant/additive~graphite-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~4-1-8-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~36-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7610A253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227610A253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095126%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000120423%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~32-m-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=lubricants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003432878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001609479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36630 pages (at 56 pages/min), scraped 812 items (at 5 items/min)
2026-01-04 11:45:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rulers/length~32-m-1/
2026-01-04 11:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:17 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001609479%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~4-1-8-ft&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/screw-size~no-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/screw-size~no-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~0151&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-water-and-oil-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/hex-size~9-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=o-rings/dash-number~902&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=made-in-america-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-screw-size~no-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-screw-size~no-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1813A253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221813A253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air%2c-water%2c-and-oil-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143799%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/hex-size~9-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spacers/for-screw-size~no-4/
2026-01-04 11:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spacers/for-screw-size~no-7/
2026-01-04 11:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001694958%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:45:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9452K243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229452K243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rulers/length~75-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143799%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/od~25-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-actuators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3043912520240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3043912520240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595074%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36674 pages (at 44 pages/min), scraped 813 items (at 1 items/min)
2026-01-04 11:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-vinyl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulers/length~75-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/thread-size~1-1-4-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143799%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/od~25-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-body-saw-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/rulers/length~75-ft-/
2026-01-04 11:46:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/thread-size~1-2-20-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spacers/material~iron/
2026-01-04 11:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000029468%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/thread-size~1-563-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=off-set-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3715417604535&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=o%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3715417604535%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000143799%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/thread-size~1-2-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=office-trash-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/thread-size~1-563-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=rulon-round-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spacers/thread-size~1-2-20/
2026-01-04 11:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~3321&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=run-capacitors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spacers/thread-size~1-563-18/
2026-01-04 11:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~403&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002094809%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/washer-type~tab/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-conditioning-hose/for-use-with~r-407c-refrigerant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36725 pages (at 51 pages/min), scraped 813 items (at 0 items/min)
2026-01-04 11:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080139%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1700A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221700A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/for-use-on~precision-measurement-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-conditioning-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~4200-fc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2357252853437&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20conditioning%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2357252853437%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cushions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74765A53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274765A53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/washer-type~tab-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1700A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221700A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/spacers/washer-type~tab-lock/
2026-01-04 11:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=67015A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2267015A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2357252853437&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20conditioning%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2357252853437%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spade-terminal-timing-relays/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~4475&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/manufacturer~tap-magic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1700A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221700A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~4799&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2357252853437&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20conditioning%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2357252853437%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002089237%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spade-terminal-timing-relays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002250048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002138443%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saddle-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75285A65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275285A65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:05 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002250048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/manufacturer~tap-magic&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:48:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1700A251&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221700A251%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:48:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7509A816&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227509A816%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:10 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2357252853437&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20conditioning%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2357252853437%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984480%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36777 pages (at 52 pages/min), scraped 815 items (at 2 items/min)
2026-01-04 11:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:48:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saddles/finish~zinc-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/sae-viscosity-grade~5w-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/material~863-iron-copper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~5438&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/signs/message~caution-speed-bump/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cylinders/clean-room-standard~fed-std-class-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-cylinders/linear-air-cylinder-type~round-body&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~krytox-240ac-type-iii&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963546299000&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=saddles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963546299000%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542944%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003415240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144256%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4216247920660&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20cylinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4216247920660%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001485027%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4216247920660&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20cylinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4216247920660%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002243608%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-863-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8149K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228149K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=speed-bump-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6837N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226837N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003415240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air%2c-water%2c-and-oil-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sae-square-head-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003415240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36829 pages (at 52 pages/min), scraped 820 items (at 5 items/min)
2026-01-04 11:49:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~lubriplate-no-1444&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~7387&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filter-frames/hvac-filter-trade-size~12-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-hard-hat-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-dollies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-hasps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002093362%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084114%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9074576958623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filter%20frames&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9074576958623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002066782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003415240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-pipe-hex-reducing-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10195K821&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210195K821%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~8277&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-stairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/hvac-filter-trade-size~10-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-glasses/lens-properties~ventilated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/hvac-filter-trade-size~10-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~922&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~synxtreme-hd-2-220&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095184%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051848%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-glasses/lens-properties~ventilated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002357543%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~tap-magic-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085881%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-skate-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7605A16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227605A16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-glasses/performance~impact-resistant-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002088973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36881 pages (at 52 pages/min), scraped 821 items (at 1 items/min)
2026-01-04 11:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7585A44&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227585A44%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10175K212&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210175K212%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/safety-glasses/uv-protection-rating~99-0/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=751624917026&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=safety%20glasses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B751624917026%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:24 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/products/safety-glasses/lens-properties~ventilated/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Destination host connect timeout'}]
2026-01-04 11:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:24 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/products/safety-glasses/lens-properties~ventilated/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Destination host connect timeout'}]
2026-01-04 11:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-glasses/uv-protection-rating~100-0&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spiral-snap-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~velocite-no-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-glasses/uv-protection-rating~99-0-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=751624917026&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=safety%20glasses&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B751624917026%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002056229%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/hvac-filter-trade-size~18-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129211%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/hvac-filter-trade-size~20-26&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/safety-glasses/uv-protection-rating~99-0-/
2026-01-04 11:50:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/metal-storage-drums/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spiral-snap-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~dp640&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002053065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005043252%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002111894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-harnesses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-flow-sights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metal-storage-drums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7467A78&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227467A78%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper/grit~2000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36933 pages (at 52 pages/min), scraped 825 items (at 4 items/min)
2026-01-04 11:51:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil-gauging-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2386623665772&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sandpaper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2386623665772%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003150756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sandpaper/grit~600/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-filters/ul-file-number~r6378&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper/grit~320&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-scoreboards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005166938%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=safety-shoes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~pc-7455&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-tube-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2386623665772&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sandpaper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2386623665772%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096658%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper/grit~600-grit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=glue&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oilers/for-use-with~polishing-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sbr-rubber-bumpers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sandpaper/grit~600-grit/
2026-01-04 11:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005166938%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/measurement-unit~kilograms/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4227901971716&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oilers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4227901971716%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968111%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spool-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:05 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4227901971716&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oilers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4227901971716%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968111%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oilers/for-use-with~polishing-compounds&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 11:52:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=schedule-80-nipples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 36986 pages (at 53 pages/min), scraped 826 items (at 1 items/min)
2026-01-04 11:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005166938%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-steel-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=metric-t-slotted-framing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scissors/for-use-on~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spool-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=one-way-screw-removers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5158413542405&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=scissors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5158413542405%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929750%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=go-no-go-outside-diameter-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=851279397977&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20filters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B851279397977%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005166938%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-241&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=goggle-replacement-headbands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=optical-center-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sampling-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504174%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=optical-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=orange-degreasers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/id~0-444&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K359&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K359%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-paint/color~case-power-tan/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493326%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-paint/color~blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-type~screw-on-terminal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K743&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K743%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37038 pages (at 52 pages/min), scraped 826 items (at 0 items/min)
2026-01-04 11:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outdoor-furniture&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-piles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K359&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K359%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=mobile-device-cases/for-use-with~iphone-11-pro-smartphones&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spray-paint/color~skyjack-orange/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~case-power-tan&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-terminals-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/mobile-device-cases/for-use-with~iphone-11-pro-smartphones/
2026-01-04 11:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002194711%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K743&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K743%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprayers/for-use-with~polyurethane-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K359&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K359%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~skyjack-orange&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-5-titanium-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdriver-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002192730%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K743&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K743%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/driver-style~l-key&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprayers/for-use-with~polyurethane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:53:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6100K359&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226100K359%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper/grit~3000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sandpaper/grit~360/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310948%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977152461181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977152461181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89895K743&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289895K743%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2386623665772&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sandpaper&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2386623665772%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003267605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37088 pages (at 50 pages/min), scraped 826 items (at 0 items/min)
2026-01-04 11:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprayon-lu-910&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-clip-links/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outlets/current-voltage~1-8-amp-15v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpaper/grit~360-grit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9978812115307&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outlets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9978812115307%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001991036%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sandpaper/grit~360-grit/
2026-01-04 11:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outline-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-clip-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3741T32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223741T32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~186&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sandpiper-pump-parts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ms-21045-hex-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-c-steel-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001619417%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/fastener-head-type~thumb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3741T32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223741T32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=outside-micrometers/manufacturer-model-number~340-720&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5040K456&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225040K456%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-plungers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose-safety-lanyards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001601421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8260587697623&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=outside%20micrometers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8260587697623%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005342992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37141 pages (at 53 pages/min), scraped 826 items (at 0 items/min)
2026-01-04 11:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-quick-disconnect-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3741T32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223741T32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5040K456&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225040K456%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oven-furnaces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oven-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-returns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3741T32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223741T32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sanitary-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5040K456&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225040K456%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~3-4-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spring-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oven-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-returns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-s2-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~5-8-11-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:55:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5040K456&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225040K456%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=over-the-glasses-safety-goggles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-nozzles/material~polypropylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37192 pages (at 51 pages/min), scraped 826 items (at 0 items/min)
2026-01-04 11:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=overhead-lights/light-technology~incandescent&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2158951760495&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2158951760495%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=santoprene-foam-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1354754625081&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=overhead%20lights&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1354754625081%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968676%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=santoprene-rubber-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-exhausters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=14685K65&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2214685K65%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=overlay-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-powered-hammer-retainers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sapphire-polishing-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/finish~epoxy-coated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas1351c-5-16-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~1-063/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~1-625/length~1-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=graphite-sprays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nas1352c-3-12-socket-head-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001546373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-registers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/for-use-on~asphalt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nasm15795/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-hose/length~100-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~1-063inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37242 pages (at 50 pages/min), scraped 827 items (at 1 items/min)
2026-01-04 11:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nasm15795/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~1-625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~13-75/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/color~dark-blue-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2926966782365&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20hose&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2926966782365%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001613252%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~1-063inches/
2026-01-04 11:57:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~1-625inches/
2026-01-04 11:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nasm-15795-804-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nasm-15795-805b-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/saws/for-use-on~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=packing-list-envelopes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~13-75inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sheets/material~natural-gum-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/color~dark-blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~plastic-1/for-use-on~polycarbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~13-75inches/
2026-01-04 11:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grease/color~dark-blue/
2026-01-04 11:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~2-812/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saws/for-use-on~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940619%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-hose/length~50-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=natural-foam-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/saws/for-use-on~steel/
2026-01-04 11:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=padded-stools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/for-use-on~worm-gears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~2-812inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37289 pages (at 47 pages/min), scraped 827 items (at 0 items/min)
2026-01-04 11:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929599%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~2-812inches/
2026-01-04 11:58:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=saws/manufacturer~dake&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing&srchtxt=&mixedworld=force&workstationdata=true> (failed 3 times): 500 Internal Server Error
2026-01-04 11:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/manufacturer~crc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:23 [scrapy.spidermiddlewares.httperror] (PID: 126) INFO: Ignoring response <500 https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing&srchtxt=&mixedworld=force&workstationdata=true>: HTTP status code is not handled or not allowed
2026-01-04 11:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~3-438/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~diesel-fuel-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K85&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K85%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/saws/manufacturer~dake/
2026-01-04 11:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/allen-screws/material~polypropylene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sb-as-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002252145%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=allen-key-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~44-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=neoprene-weatherstripping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~3-438inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=allen-screws/material~polypropylene-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-bar-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~44-5millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:58:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/allen-screws/material~polypropylene-plastic/
2026-01-04 11:59:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~3-438inches/
2026-01-04 11:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seating-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~56-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alligator-belt-lacing/lacing-number~1as&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nickel-coated-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~44-5millimeters/
2026-01-04 11:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/measurement-unit~feet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37337 pages (at 48 pages/min), scraped 828 items (at 1 items/min)
2026-01-04 11:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3797964781943&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=alligator%20belt%20lacing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3797964781943%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000083996%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~6-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/scales/measurement-unit~tons/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~56-8millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6118K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226118K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pail-lid-openers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scales/scale~feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pail-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~56-8millimeters/
2026-01-04 11:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~6-5inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~dark-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964782%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 11:59:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/scales/scale~feet/
2026-01-04 11:59:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scales/scale~tons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/material~zinc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/material~polyester-elastomer-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002203177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/bore-type~bushing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/scales/scale~tons/
2026-01-04 11:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/bore-type~finished/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/length~6-5inches/
2026-01-04 11:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=alumina-oxide-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~genie-lift-blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 11:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/material~polyester-rubber-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/bore-type~bushing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002203882%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=schlage-m420-electromagnetic-door-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/bore-type~finished&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=serrated-flange-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37385 pages (at 48 pages/min), scraped 829 items (at 1 items/min)
2026-01-04 12:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/springs/material~polyester-rubber-blend/
2026-01-04 12:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~1-25/shaft-diameter~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001937869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=schrader-valve-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001929672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-bars/material~aluminum-2/material~mic6-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/for-shaft-diameter~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nitrile-rubber-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/paint/for-use-on~plastic-1/for-use-on~polycarbonate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clamp-on-structural-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~rarus-827&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scissors/performance~metal-detectable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sprockets/for-shaft-diameter~1-1-4/
2026-01-04 12:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/for-use-on~sbr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-bars/material~aluminum/material~mic6-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grease&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002129823%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5158413542405&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=scissors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5158413542405%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nonmetallic-outlet-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nsf%252fansi-standard-quick-disconnect-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/for-use-on~polycarbonate-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940377%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9990216947512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20bars&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9990216947512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-clamp-on-structural-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6427N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226427N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/finish~passivated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/paint/for-use-on~polycarbonate-plastic/
2026-01-04 12:01:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37436 pages (at 51 pages/min), scraped 831 items (at 2 items/min)
2026-01-04 12:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flat-washers/material~plastic-1/material~nylon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/locking-type~steel-insert&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nuts/finish~passivated&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-extrusion-end-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-motors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shaft-shims/shaft-type~d-profile/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-gun-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint-sprayer-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5479875482882&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5479875482882%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974171%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-seals/for-use-with~phosphoric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylatron-flat-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1157601946191&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shaft%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1157601946191%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965403%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~2-5/diameter~2-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-shims/shape~d-profile&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-cup-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=painting-telescoping-poles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=air-slides/clean-room-standard~fed-std-class-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9968617833451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shaft%20shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9968617833451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310549%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=green-light-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7147879609086&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=air%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7147879609086%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001485027%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grid-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~2-5/diameter~2-1-2-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37487 pages (at 51 pages/min), scraped 831 items (at 0 items/min)
2026-01-04 12:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/aluminum-plates/thickness~20-000-mm/thickness~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-plates/thickness~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6837N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226837N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000138872%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shears/performance~nonsparking-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9495772993241&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9495772993241%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001453258%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~m20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=nylon-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-plates/thickness~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shears/performance~nonsparking-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-conveyors/environment~sanitary&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shears/handle-material~beryllium-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/aluminum-plates/thickness~20mm/
2026-01-04 12:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheet-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5847281553902&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shears&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5847281553902%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002235310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheet-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5586301808702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screw%20conveyors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5586301808702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5847281553902&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shears&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5847281553902%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145998%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-rods/material~aluminum-2/material~6013-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=off-delay-relay&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/number-of-teeth~120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-mount-fuse-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9951954787837&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9951954787837%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511688%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screw-mount-rubber-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5586301808702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screw%20conveyors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5586301808702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37539 pages (at 52 pages/min), scraped 832 items (at 1 items/min)
2026-01-04 12:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~lb-8423-dielectric-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=panel-slides/panel-slide-mount-type~twist-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oil/trade-name~molykote-p-1900-anti-seize-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096064%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6155309447017&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=panel%20slides&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6155309447017%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/number-of-teeth~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/for-use-on~plaster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-ties/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6443712110985&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=oil&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6443712110985%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083740%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533052%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5586301808702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screw%20conveyors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5586301808702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1821A55&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221821A55%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-welding-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T448&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T448%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:43 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/for-use-on~plaster&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-wire-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shields/performance~impact-resistant-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/roller-chain-trade-number~120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5586301808702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screw%20conveyors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5586301808702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002231441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T448&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T448%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~sae-standard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=allen-driver-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/form~sheet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchor-rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/split-lock-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shields/performance-properties~impact-resistant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-trade-size~120-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T448&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T448%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37588 pages (at 49 pages/min), scraped 833 items (at 1 items/min)
2026-01-04 12:04:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/sae-washers-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wide-rim-ring-shims/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shields/performance-properties~impact-resistant/
2026-01-04 12:04:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sprockets/roller-chain-trade-size~120-ss/
2026-01-04 12:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/anchors/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/roller-chain-trade-number~c2060h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/shape~sheet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/sae-washers-8/
2026-01-04 12:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/split-lock-washers-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002310262%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5537T448&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225537T448%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/wide-rim-ring-shims-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/split-lock-washers-8/
2026-01-04 12:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shipping-crates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-trade-size~c2060h-ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shipping-trays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~15-64-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/wide-rim-ring-shims-6/
2026-01-04 12:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/drive-size~22-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/sprockets/roller-chain-trade-size~c2060h-ss/
2026-01-04 12:04:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/anchors/material~bronze/
2026-01-04 12:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parker-compressed-air-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003490110%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/thread-size~8-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oxygen-monitors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=oxygen-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w141&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shock-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37640 pages (at 52 pages/min), scraped 833 items (at 0 items/min)
2026-01-04 12:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/thread-size~6-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004751771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w163&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004751771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w141&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:05:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333393%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w170&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parts-cleaning-vacuum%252fblowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124315%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=parts-washing-cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125395%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-globe-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-grinders/manufacturer-model-number~2882-22&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:41 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002124315%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w163&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=passivating-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9287102609142&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20bits&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9287102609142%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125395%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-bits/shape-number~w170&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pads/material~titanium-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9993435663610&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=angle%20grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9993435663610%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004877138%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5124285600057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screwdrivers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5124285600057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003489921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/material~3105-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/square-tube-inserts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paste-wax&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=patio-umbrellas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=side-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5069306377488&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5069306377488%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511170%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pads/material~titanium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=paint/color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum/material~aluminum-2/material~a356-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37691 pages (at 51 pages/min), scraped 833 items (at 0 items/min)
2026-01-04 12:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squares/material~a588-alloy-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pads/material~titanium/
2026-01-04 12:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5069306377488&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5069306377488%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000008512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512436%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-tube-inserts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/abrasive-material~ceramic-alumina-zirconia-alumina-blend-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/squirrel-cage-blowers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/abrasive-material~nylon-mesh-aluminum-oxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squares/material~a588-alloy-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ansi-120-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sign-chains&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958961006685&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958961006685%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/abrasive-material~ceramic-alumina-zirconia-alumina-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squirrel-cage-blowers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/abrasive-material~nylon-mesh-aluminum-oxide-blend&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/abrasive-material~nylon-mesh-aluminum-oxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9055N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229055N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grinding-wheels/abrasive-material~ceramic-alumina-zirconia-alumina-blend/
2026-01-04 12:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silica&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grinding-wheels/abrasive-material~nylon-mesh-aluminum-oxide-blend/
2026-01-04 12:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~sr516sw/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~sr60/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001515985%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37739 pages (at 48 pages/min), scraped 833 items (at 0 items/min)
2026-01-04 12:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9055N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229055N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silver-solder&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sr60-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anti-siphon-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4999700653188&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4999700653188%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sr516sw-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antiseize-sticks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=single-strand-roller-chain-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9055N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229055N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4700A821&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224700A821%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~1-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-on~cbn-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pendant-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9055N112&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229055N112%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anvils&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-ansi-pipe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sleeve-dowels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~1-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~1-11-16/
2026-01-04 12:08:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~1-4/
2026-01-04 12:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37789 pages (at 50 pages/min), scraped 834 items (at 1 items/min)
2026-01-04 12:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=appliance-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-ansi-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slide-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-butt-weld-tube-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arbor-press-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arbors/for-holding~drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-035&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4531265455181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=arbors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4531265455181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-butt-weld-tube-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~m6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~no-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-conduit/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=arc-flash-protection-underwear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slitting-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=30505A5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2230505A5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:51 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grinding%20wheels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~no-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-conduit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screwdrivers/drive-size~pls25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=30505A5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2230505A5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pg29-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~m6/
2026-01-04 12:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~no-10/
2026-01-04 12:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37839 pages (at 50 pages/min), scraped 834 items (at 0 items/min)
2026-01-04 12:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-068&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flags/message~army/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screwdrivers/size~pls25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=30505A5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2230505A5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-072&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-acting-switches/csa-file-number~004442-c-000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screwdrivers/size~pls25/
2026-01-04 12:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=as3578-o-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-113&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:09:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-068&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5714597745783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=snap%20acting%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5714597745783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005502916%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=army-flags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=30505A5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2230505A5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000042233%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001530959%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-072&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7090K215&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227090K215%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-in-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000042233%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-113&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=asme-heat-exchangers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-on-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-145&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-149&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~no-14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=assembly-point-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pickle-forks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37892 pages (at 53 pages/min), scraped 835 items (at 1 items/min)
2026-01-04 12:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543110%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/expandable-grommets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=picks/material~brass-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543450%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-145&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:10:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543110%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-149&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:10:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/drive-size~no-14-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-b453-brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5551314863993&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=picks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5551314863993%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/drive-size~no-14-1/
2026-01-04 12:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/expandable-grommets-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-f68-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pillar-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/hole-diameter~1-3-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-207&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-structural-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grommets/expandable-grommets-6/
2026-01-04 12:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545062%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pillow-pak-ink-tyvek-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pilot-bearing-pullers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/for-hole-diameter~1-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545062%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-207&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=attache-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pilot-weld-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=audio-adapters/electrical-connection~usb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/grommets/for-hole-diameter~1-3-16/
2026-01-04 12:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-wrench-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37945 pages (at 53 pages/min), scraped 835 items (at 0 items/min)
2026-01-04 12:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-2496&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984858568963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=audio%20adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984858568963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=automatic-center-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~19-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-365&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/size~0-09375inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984858568963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=audio%20adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984858568963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/size~0-09375inches/
2026-01-04 12:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-in-hex-drivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~24-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=automatic-shoe-wash-stations&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/size~19millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~0-365&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-pop-safety-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aluminum-plates/thickness~6-000-mm/thickness~6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/size~19millimeters/
2026-01-04 12:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~ip1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984858568963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=audio%20adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984858568963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/size~24millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9495772993241&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=aluminum%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9495772993241%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464191%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464484%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-pop-safety-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/for-station-manufacturer-model-number~wtcps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/size~24millimeters/
2026-01-04 12:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/drive-size~ip7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=aviation-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 37994 pages (at 49 pages/min), scraped 835 items (at 0 items/min)
2026-01-04 12:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/size~ip1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pin-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984858568963&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=audio%20adapters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984858568963%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448939%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:12:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solder/for-station-manufacturer-model-number~wtcps/
2026-01-04 12:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/size~ip1/
2026-01-04 12:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pinch-valves/body-material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/diameter~2-5000-mm/diameter~2-500-mm/diameter~2-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~ax47/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/size~ip7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001518703%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pins/pem-part-number~mpp-1mm-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax24-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/size~ip7/
2026-01-04 12:12:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~1-1-8-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-1-8-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pinch-valves/body-material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/diameter~2-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ax47-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoid-control-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=pins/captive-pins-5/pem-part-number~mpp-1mm-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455154%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pinch-valves/body-material~steel/
2026-01-04 12:12:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/pins/diameter~2-5mm/
2026-01-04 12:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~1-3-4-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-1-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvent-resistant-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=315582308815&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B315582308815%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133711%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-step-treads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/screws/thread-size~1-7-8-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/thread-size~1-1-8-8/
2026-01-04 12:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~b225/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-wall-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=axles/diameter~2-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38041 pages (at 47 pages/min), scraped 835 items (at 0 items/min)
2026-01-04 12:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stainless-steel-wave-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-3-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-step-treads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681008859035&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=axles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681008859035%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001537915%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~1-7-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/thread-size~1-3-4-8/
2026-01-04 12:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=b225-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grounding-rings/motor-frame-size~nema-256t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grounding-ribbon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-wall-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1497K341&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221497K341%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/screws/thread-size~1-7-8-8/
2026-01-04 12:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-wave-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6573339806813&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=grounding%20rings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6573339806813%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001573930%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=b64-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws/thread-size~m33&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1497K341&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221497K341%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spline-broaches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=screws-for-hardwood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/rotary-hammers/for-bit-shank-type~sds-plus/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5875341805879&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5875341805879%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334820%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=b90-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=scriber-tips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=backward-compatible-usb-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1497K341&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221497K341%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38093 pages (at 52 pages/min), scraped 835 items (at 0 items/min)
2026-01-04 12:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standard-polyurethane-hollow-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprayers/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sds-plus-rotary-hammers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977152461181&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprayers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977152461181%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sea-foam-motor-treatments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spreading-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bag-lifters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1497K341&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221497K341%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprayers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-polyurethane-hollow-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity~23-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprayers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity~250-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bags/capacity~7-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3965717477234&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bags&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3965717477234%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002079659%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity~4-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealant-primers/for-use-on~sbr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rail-carriages/carriage-width~47-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3965717477234&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bags&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3965717477234%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-loaded-seals/for-use-with~sodium-bicarbonate-baking-soda&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3965717477234&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bags&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3965717477234%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115729%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8652411469468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealant%20primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8652411469468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940377%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealant-primers/for-use-on~polystyrene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2531858902349&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rail%20carriages&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2531858902349%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000078256%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7013N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227013N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bags/capacity-weight-~7-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38145 pages (at 52 pages/min), scraped 835 items (at 0 items/min)
2026-01-04 12:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9759667665353&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spring%20loaded%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9759667665353%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984590%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoffs/thread-size~3-8-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8652411469468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealant%20primers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8652411469468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002940712%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6709K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226709K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bags/capacity-weight-~7-gal-/
2026-01-04 12:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-plungers/spring-plunger-nose-type~long&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoffs/thread-size~5-8-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoffs/thread-size~m10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/shaft-diameter~25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8838367764647&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spring%20plungers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8838367764647%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001935878%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stanley-compatible-staples/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-rails/rail-width~40-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~5-8-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~m10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/for-use-with~boric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~8inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/for-shaft-diameter~25mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=132998792534&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=guide%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B132998792534%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334459%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964962%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~8inches/
2026-01-04 12:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stanley-compatible-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/for-shaft-diameter~25mm/
2026-01-04 12:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~196-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6109K205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226109K205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/anchors/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/micrometers/manufacturer~starrett-1/manufacturer-model-number~436-1xrl-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38190 pages (at 45 pages/min), scraped 837 items (at 2 items/min)
2026-01-04 12:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/u-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/starrett-calipers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-screw-end-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/starrett-micrometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2696N33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222696N33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6109K205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226109K205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/thread-size~m12-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=starrett-4361xrl-3-micrometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anchors/u-bolts-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=starrett-calipers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9726243375694&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=anchors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9726243375694%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000009660048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-spline-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=starrett-micrometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/anchors/u-bolts-6/
2026-01-04 12:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2696N33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222696N33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6109K205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226109K205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ballasts/bulb-shape-number~t12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hair-bun-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6109K205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226109K205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:17:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2696N33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222696N33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/pitch~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer~scigrip&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer~weldwood&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ballasts/bulb-shape-number~t8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531605%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/formulation~polyurea&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38243 pages (at 53 pages/min), scraped 837 items (at 0 items/min)
2026-01-04 12:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002255353%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9103241651062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ballasts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9103241651062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002060774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ballasts/for-bulb-shape-number~t12-ho&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139455%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2696N33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222696N33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8345K91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228345K91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/ballasts/for-bulb-shape-number~t12-ho/
2026-01-04 12:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/static-control-chairs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~10110&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/static-control-pvc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~0-787&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-chairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~220&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529826%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/shaft-diameter~5-8-to-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=angle-scales&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~13-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3748K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223748K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003178218%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547776%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38295 pages (at 52 pages/min), scraped 838 items (at 1 items/min)
2026-01-04 12:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102295%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6325K138&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226325K138%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244920%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3748K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223748K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe-fittings/pressure-class~150/pipe-material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~10-lb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-stainless-steel-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/diameter~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squeeze-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3748K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223748K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000108547%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-ball-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-(class-150)-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~10-lb&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=balls/mount-type~threaded-stud&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-banding/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9949660162619&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=balls&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9949660162619%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:18:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002116869%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-barbed-hose-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~3-oz&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:02 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3748K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223748K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543409%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38345 pages (at 50 pages/min), scraped 839 items (at 1 items/min)
2026-01-04 12:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-banding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-barbed-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~9-oz&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:21 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001543409%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~3-oz&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:19:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stand-up-desks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barbed-tube-fittings-for-3-a-sanitary-clear-pvc-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549263%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-held-mirrors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:39 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=34195930483&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=hammers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B34195930483%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549263%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~9-oz&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=anti-skid-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-welding-electrodes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/standoffs/thread-size~m12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-moisturizers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=antifriction-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrel-funnels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-heavy-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stands/mount-type~lug&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~m12-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=star-ring-terminals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9962802582025&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stands&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9962802582025%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010924%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/manufacturer-model-number~922&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38397 pages (at 52 pages/min), scraped 839 items (at 0 items/min)
2026-01-04 12:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=standoffs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000009660048%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-heavy-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=status-indicating-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bars/material~epdm-neoprene-sbr-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-beams&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085881%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pin-punches/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9990216947512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bars&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9990216947512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roller-chain-links/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-gate-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealants/military-specification~mil-a-46106-type-i/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8647K102&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228647K102%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085881%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/material~aluminum-bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-connection~post-and-stud-terminal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-pin-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/square-drive-size~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=handles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001542540%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003406311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/battery-connection~solder-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-roller-chain-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/military-specifications-met~mil-a-46106-type-i&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=handles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000160169%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085881%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71805K18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271805K18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sealants/military-specifications-met~mil-a-46106-type-i/
2026-01-04 12:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5525A13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225525A13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealants/specifications-met~fed-spec-tt-s-001543-class-a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/connects-to~battery/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38448 pages (at 51 pages/min), scraped 841 items (at 2 items/min)
2026-01-04 12:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/data-connection~bluetooth/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/battery-connection-type~solder-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=step-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002361474%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=681742819075&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B681742819075%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085881%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/batteries/battery-connection-type~solder-wire/
2026-01-04 12:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~cement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7436A41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227436A41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/connection-type~battery&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stick-electrodes/diameter~0-125&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/data-connection~bluetooth-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sealers/for-use-on~foam-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~100003a092&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-short-radius-pipe-elbows/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930098%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/batteries/connection-type~battery/
2026-01-04 12:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9938597167718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stick%20electrodes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9938597167718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/batteries/data-connection~bluetooth-1/
2026-01-04 12:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~foam-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handrails/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1671N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221671N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7972A228&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227972A228%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealers/for-use-on~foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-spring-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-strut-channel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984350057510&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sealers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984350057510%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929645%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-short-radius-pipe-elbows&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140735%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:21:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sealers/for-use-on~foam/
2026-01-04 12:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~24y4008&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2654N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222654N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handrails/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-t-handle-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drive-pins/pin-type~taper/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-spring-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-strut-channel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38495 pages (at 47 pages/min), scraped 845 items (at 4 items/min)
2026-01-04 12:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084595%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/handrails/material~iron/
2026-01-04 12:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N88&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N88%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~407940&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-tube-couplings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-t-handle-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/steel-turnbuckles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-taper-drive-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sealing-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~1-2-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~4r25y&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-tube-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/seals/shaft-diameter~47-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-turnbuckles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098961%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strip-door-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7690K22&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227690K22%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stencils/material~oilboard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-shaft-diameter~47mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~908d&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/for-shaft-diameter~1-2/
2026-01-04 12:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=structural-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hard-hat-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/seals/for-shaft-diameter~47mm/
2026-01-04 12:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38546 pages (at 51 pages/min), scraped 850 items (at 5 items/min)
2026-01-04 12:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=astm-a193-threaded-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002105282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=structural-framing-systems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stencils/material~oilboard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7690K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227690K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~cutting-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~ba0254&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~bgn800-8bwp-500ec&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1989175495876&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1989175495876%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512365%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965692%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~br-agcf2w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrically-conductive-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080152%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136262%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=harsh-environment-motor-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7690K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227690K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N39&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N39%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/for-use-with~r-404a-refrigerant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrically-insulated-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080152%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984396%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrically-conductive-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7690K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227690K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stubby-screwdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stud-mount-track-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4538K1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224538K1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38598 pages (at 52 pages/min), scraped 851 items (at 1 items/min)
2026-01-04 12:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrically-insulated-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080152%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hat-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:18 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7690K24&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227690K24%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrodes/aws-material-code~er70s-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electrodes/for-joining~bronze-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hat-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stoppers/mount-type~hammer-on/mount-type~tack/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hatch-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080152%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/electronic-equipment-cooling-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~dl2354&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrodes/aws-material-code~er70s-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrodes/for-joining~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=support-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stoppers/mount-type~hammer-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098291%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N23&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N23%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994383438024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994383438024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electronic-equipment-cooling-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:24:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/electrodes/for-joining~bronze/
2026-01-04 12:25:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/stoppers/mount-type~hammer-in/
2026-01-04 12:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=automatic-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~ecr2016/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:04 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994383438024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994383438024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002325995%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=electrodes/aws-material-code~er70s-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stoppers/shape~doughnut/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38646 pages (at 48 pages/min), scraped 852 items (at 1 items/min)
2026-01-04 12:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098291%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=supports/mount-type~screw&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seals/material~ptfe-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=automatic-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9992627010166&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=supports&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9992627010166%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011043%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-material-shipping-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swing-check-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stoppers/shape~doughnut&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~ecr2016/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3146508506032&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3146508506032%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510299%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hdmi-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098291%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977840261548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977840261548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002311290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/storage-cabinets/color~white/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-caps/fitting-connection~flanged/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:47 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977840261548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977840261548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002311290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stoppers/shape~doughnut&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:25:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~ecr2016&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-caps/framing-type~clamp-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/enclosure-rating~ip20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098291%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=seamless-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002105801%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/environment~corrosive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-caps/connection-style~flanged&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=storage-cabinets/color~white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/cut-style~gear/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~lap3305&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-caps/framing-type~clamp-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/environmental-rating~ip20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000055772%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/end-caps/connection-style~flanged/
2026-01-04 12:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7701K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227701K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38694 pages (at 48 pages/min), scraped 852 items (at 0 items/min)
2026-01-04 12:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~lf1500&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5822928825602&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5822928825602%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098288%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6395309901074&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6395309901074%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969145%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/environmental-rating~ip20/
2026-01-04 12:26:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/cut-style~gear&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2267N53&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222267N53%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2534T15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222534T15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straight-thread-pipe-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~0-003/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~0-005/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7745K55&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227745K55%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=headphone-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002240023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~ls9v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3034A313&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223034A313%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainer-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straight-thread-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-003&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002144773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/for-use-with~coolant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/ul-file-number~e78403&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:26:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001719171%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7745K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227745K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~0-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/for-use-with~natural-gas-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainer-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-gun-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/for-use-with~sodium-nitrate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005631777%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~coolant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38742 pages (at 48 pages/min), scraped 858 items (at 6 items/min)
2026-01-04 12:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9235K2&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229235K2%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~natural-gas&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/material~fabric-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~sodium-nitrate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~0-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strainers/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/strainers/for-use-with~natural-gas/
2026-01-04 12:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001727740%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-leveling-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~25-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/material~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98805K43&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298805K43%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~q6bat&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringe-needles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/strainers/material~fabric/
2026-01-04 12:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/syringe-tips/needle-gauge~24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114080%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~25-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:27:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/strainers/material~plastic/
2026-01-04 12:28:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straps/hook-type~grab/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straps/hook-type~locking/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringes/capacity~200-microl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2286N32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222286N32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9654196912961&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9654196912961%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001720053%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5000N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225000N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/end-mills/mill-diameter~9-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straps/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38789 pages (at 47 pages/min), scraped 860 items (at 2 items/min)
2026-01-04 12:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringe-tips/needle-gauge~24-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1134507702014&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=syringes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1134507702014%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002197720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8848A729&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228848A729%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/hook-style~grab&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/endless-slings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/hook-style~locking&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/syringe-tips/needle-gauge~24-ga/
2026-01-04 12:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7015T17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227015T17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/straps/sling-type~rope/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=end-mills/mill-diameter~9-5mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/straps/hook-style~grab/
2026-01-04 12:28:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/straps/hook-style~locking/
2026-01-04 12:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/end-mills/mill-diameter~9-5mm/
2026-01-04 12:28:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/straps/material~iron/
2026-01-04 12:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epdm-rubber-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=endless-slings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slot-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/sling-type~rope&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-angles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/voltage~60v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/voltage~12v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-sink-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9733419879211&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9733419879211%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001603974%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/voltage~600v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:28:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epdm-rubber-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553683%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1613N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221613N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003552889%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/strobe-hazard-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38838 pages (at 49 pages/min), scraped 863 items (at 3 items/min)
2026-01-04 12:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=serrated-thread-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6948K91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226948K91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553683%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strobe-hazard-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=servit-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=servo-couplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/structural-adhesives/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/for-use-on~plaster/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-chargers/battery-voltage~9-6v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553683%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heated-blade-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/structural-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8428166447802&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=battery%20chargers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8428166447802%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313311%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-resistant-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/for-use-on~plaster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=27875A78&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2227875A78%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=set-screws/material~nickel-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/manufacturer-model-number~1838l/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:01 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553683%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=structural-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4940968732154&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=set%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4940968732154%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000088769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38887 pages (at 49 pages/min), scraped 866 items (at 3 items/min)
2026-01-04 12:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/set-screws/military-specification~ms51963-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-surge-protectors-charge-monitors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~1838l&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heating-elements/for-use-with~salt-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxies/manufacturer-model-number~ea-9131/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stubby-screwdrivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tap-sets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-rulers/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002080740%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=set-screws/specifications-met~ms51963-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1929453200661&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=heating%20elements&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1929453200661%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964965%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/epoxy-resins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9942415585721&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9942415585721%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~m5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=75065A74&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2275065A74%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/set-screws/specifications-met~ms51963-24/
2026-01-04 12:30:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4668T51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224668T51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxies/manufacturer-model-number~ea-9131&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/individual-set~set&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000011539%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=epoxy-resins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/equipment-identification-labels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2997781987034&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2997781987034%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002140830%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/taps/individual-set~set/
2026-01-04 12:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9942415585721&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9942415585721%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beard-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/drill-bushings/drill-bushing-type~sg/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-pipe-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38936 pages (at 49 pages/min), scraped 868 items (at 2 items/min)
2026-01-04 12:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=equipment-identification-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/adapter-sleeve-trade-number~h-308&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9942415585721&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9942415585721%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/adapter-sleeve-trade-number~h-311&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/est-(castarc)-arc-welding-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sg-drill-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nut-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003865579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003865572%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/specifications-met~astm-standard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:34 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003865579%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/adapter-sleeve-trade-number~h-308&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:31:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9942415585721&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20rulers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9942415585721%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:31:36 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003865572%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/adapter-sleeve-trade-number~h-311&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=est-(castarc)-arc-welding-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telephone-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:43 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4305942166524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20adapter%20sleeves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4305942166524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-adapter-sleeves/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/specifications-met~astm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telescoping-framing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shadow-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nuts/thread-size~m100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-end-allen-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tees/specifications-met~astm/
2026-01-04 12:31:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nuts/thread-size~m17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/support-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455500%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/exhaust-fans/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/exhaust-pipe-wrap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-displays&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 38985 pages (at 49 pages/min), scraped 868 items (at 0 items/min)
2026-01-04 12:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-switches/environment~wet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=support-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-pipe-wrap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=exhaust-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-switches/switch-designation~3pst&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-process-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=830330883100&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B830330883100%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018993%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nuts/thread-size~m50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tempering-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=830330883100&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B830330883100%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003016006%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=35055K72&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2235055K72%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/surfactants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearing-nuts/thread-size~m90&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~ofnr/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tension-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-repair-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shaft-seals/for-use-with~benzene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/suspension/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/svt-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4925004773901&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearing%20nuts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4925004773901%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1157601946191&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shaft%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1157601946191%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967302%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surfactants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/industry-designation~ofnr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39037 pages (at 52 pages/min), scraped 869 items (at 1 items/min)
2026-01-04 12:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/length~13-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/length~14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/length~30-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=suspension&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/extension-cords/industry-designation~ofnr/
2026-01-04 12:33:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=svt-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-socket-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-cords/length~48/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switch-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~13-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-cords/length~30-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~2306k&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621396%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8543165603027&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8543165603027%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616157%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/extension-cords/length~30-ft-/
2026-01-04 12:33:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130194%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~2788-2720&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switch-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=71515K33&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2271515K33%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7749K3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227749K3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/environment~oily/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3014-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-013inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002151426%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002086953%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-013inches/
2026-01-04 12:34:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ball-valves-for-sodium-hypochlorite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extension-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39083 pages (at 46 pages/min), scraped 871 items (at 2 items/min)
2026-01-04 12:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extensions/electrical-connection~usb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/environment~oily&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3022-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-makers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000102596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3040-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/extensions/socket-type~square-drive-size-adapter/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extension-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extensions/connection-type~usb&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142589%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3201-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-033&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/extensions/connection-type~usb/
2026-01-04 12:34:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/panel-cutout-diameter~3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=extensions/socket-type~square-drive-size-adapter&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-setters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A283&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A283%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9996540530177&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9996540530177%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002465816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~3303-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/for-panel-cutout-diameter~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~368a-362a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-0469&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/switches/for-panel-cutout-diameter~3-8/
2026-01-04 12:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39134 pages (at 51 pages/min), scraped 872 items (at 1 items/min)
2026-01-04 12:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112273%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/mounting-location~enclosure-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eyebolts/finish~anodized/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-057inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A113&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A113%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002104672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:35:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-076/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-inserts/thread-size~4-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-057inches/
2026-01-04 12:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eyebolts/movement~360-swivel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/mounting-location~enclosure&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switch-type~manual/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~0-35-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5458250483069&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20inserts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5458250483069%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000122836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/finish~anodized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/switches/mounting-location~enclosure/
2026-01-04 12:35:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-076inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550239%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rod-coupling-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~140-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/movement~360-swivel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switch-type~manual&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-076inches/
2026-01-04 12:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rod-sockets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-current~2-5-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~0-35a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002245078%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/switches/switching-current~0-35a/
2026-01-04 12:36:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eyebolts/thread-size~m16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39180 pages (at 46 pages/min), scraped 873 items (at 1 items/min)
2026-01-04 12:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~140a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/eyebolts/thread-size~m24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6218-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~2-5a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/switches/switching-current~140a/
2026-01-04 12:36:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-voltage~24v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003921165%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~626-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:29 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/switches/switching-current~2-5a/
2026-01-04 12:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~m16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=eyebolts/thread-size~m24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-112&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000073588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/switching-voltage~650v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1443843511411&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1443843511411%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531851%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/switches/switching-current~80a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-1285&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6706-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-150/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/switches/switching-current~80a/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K143&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K143%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001546616%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002131742%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-voltage~650v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivel-joints/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-164&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001633000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-15inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6902-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~688-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39228 pages (at 48 pages/min), scraped 874 items (at 1 items/min)
2026-01-04 12:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001523418%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6759K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226759K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-15inches/
2026-01-04 12:37:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002130130%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002137150%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/switches/switching-current~80a/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 12:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:19 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/switches/switching-current~80a/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 12:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivel-joints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thumb-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K165&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K165%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-196/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivels/material~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~21-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K165&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K165%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-196inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~10-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/material~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~22-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tilt-trucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-196inches/
2026-01-04 12:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~21-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001616556%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A243&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A243%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:37:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-4-1/diameter~0-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:37:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/swivels/material~aluminum/
2026-01-04 12:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6635333760770&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6635333760770%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K165&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K165%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000107569%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/overall-height~34-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39277 pages (at 49 pages/min), scraped 875 items (at 1 items/min)
2026-01-04 12:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~fz-6205-2rs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timing-belts/belt-trade-number~1400xh300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~7-16/diameter~0-4375/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~hpc011gp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:20 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K165&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K165%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fans/voltage~277v-ac-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106308%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/fuse-protection-type~fast-acting/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~lm67048-lm67010&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7222310939460&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=timing%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7222310939460%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005281482%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~34-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099687%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002098587%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-4375inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058390%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/drive-style~tamper-resistant-hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=toggle-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fast-acting-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-4375inches/
2026-01-04 12:38:48 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5392596535200&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5392596535200%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000058390%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fans/overall-height~34-3-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:38:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-bolt-hose-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/finish~anodized/color~blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/finish~cadmium-yellow-chromate-plated/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrel-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-blanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-bolt-hose-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~blue-anodized&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/drive-style~tamper-resistant-hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39326 pages (at 49 pages/min), scraped 875 items (at 0 items/min)
2026-01-04 12:39:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111419%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-7969&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-31-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~cadmium-yellow-chromate-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/finish~blue-anodized/
2026-01-04 12:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~1-5748&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104408%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000018876%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~0-8-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000022856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-box-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A266&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A266%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-9063&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527981%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/finish~cadmium-yellow-chromate-plated&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~0-8millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001531065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-0625/diameter~1-1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~2-7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tool-holder-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A266&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A266%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~0-8millimeters/
2026-01-04 12:39:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075706%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-11-16/diameter~1-6875&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/fastener-head-type~clipped/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=barrier-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/fastener-head-type~l-handle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-0625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000024026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000019655%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39375 pages (at 49 pages/min), scraped 875 items (at 0 items/min)
2026-01-04 12:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A266&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A266%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tooling-component-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~1-0625inches/
2026-01-04 12:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/head-type~clipped&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~1-469/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/head-type~l-handle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-0935&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/head-type~l-handle/
2026-01-04 12:40:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/head-type~clipped/
2026-01-04 12:40:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A266&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A266%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:40:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~0-469-32-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=top-hats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001495898%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~1-469inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-checkers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~0-965-14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A008&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A008%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~1-469inches/
2026-01-04 12:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-checkers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~0-469-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3023A274&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223023A274%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:40:57 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/products/torque-checkers/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 12:40:57 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/products/torque-checkers/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 12:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~0-965-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/thread-size~0-469-32/
2026-01-04 12:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/t-slotted-framing-component~cable-holder-and-duct/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~10-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-193&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453861%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39418 pages (at 43 pages/min), scraped 876 items (at 1 items/min)
2026-01-04 12:41:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tote-dollies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~11-1-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498647%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-113/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/t-slot-framing-component~cable-holder-and-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=track-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A386&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A386%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526242%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~0-113/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~11-16-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453861%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/t-slots/t-slot-framing-component~cable-holder-and-duct/
2026-01-04 12:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~12-6millimeters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/products/bearings/id~0-113/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 12:41:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A393&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A393%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:35 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/products/bearings/id~0-113/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 12:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~2-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~2-157-18-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~13-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/thread-size~m30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~14-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~11-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453861%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trade-number-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A393&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A393%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~2-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~2-157-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~12-6millimeters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/thread-size~m30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~14millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~13millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:08 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~11-16-24&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:42:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453861%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:42:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fasteners/thread-size~2-157-18/
2026-01-04 12:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~12-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-slots/thread-size~m4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39462 pages (at 44 pages/min), scraped 877 items (at 1 items/min)
2026-01-04 12:42:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9950050661528&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9950050661528%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334725%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~14millimeters/
2026-01-04 12:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A393&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A393%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:18 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451477%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~2-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:42:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~13millimeters/
2026-01-04 12:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~19-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t351-temper-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~16-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slots/thread-size~m4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-332&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~12-6millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A393&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A393%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:42:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~2-25-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-438&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000095871%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/t-slots/thread-size~m4/
2026-01-04 12:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~19millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~12-6millimeters/
2026-01-04 12:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t351-temper-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001533731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507986%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~2-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8491A226&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228491A226%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~19millimeters/
2026-01-04 12:42:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-4395&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:42:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A239&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A239%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~m220/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tri-clover-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~23-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~m38/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~2-625inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-569&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39512 pages (at 50 pages/min), scraped 879 items (at 2 items/min)
2026-01-04 12:43:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-6001&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~2-625inches/
2026-01-04 12:43:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497906%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505958%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m220&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-687&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~23millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fasteners/thread-size~m50/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m38&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K489&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K489%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trunk-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3671N18&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223671N18%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~23millimeters/
2026-01-04 12:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454497%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~3-25-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fasteners/thread-size~m50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fastening-tape/color~blue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-barbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-7525&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~3-55-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~0-846&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~3-25millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~3-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001532933%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504990%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~3-25millimeters/
2026-01-04 12:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39561 pages (at 49 pages/min), scraped 881 items (at 2 items/min)
2026-01-04 12:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/color~blue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001550976%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A268&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A268%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/take-up-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7197N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227197N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001527696%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A272&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A272%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tamper-evident-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fastening-tape/form~rectangle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fastening-tape/material~lead/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=take-up-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:38 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6136281167969&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6136281167969%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:44:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~4-1-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-evident-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fitting-gaskets/tube-od~4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/food-industry-standard~nsf-ansi-61&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1768933986141&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fitting%20gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1768933986141%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001470252%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fastening-tape/material~lead&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~4-1millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:44:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-009&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002097343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=43315K58&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2243315K58%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2355999507944&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2355999507944%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511250%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~4-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~4-1millimeters/
2026-01-04 12:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-064&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498070%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-use-with~fuel-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39612 pages (at 51 pages/min), scraped 885 items (at 4 items/min)
2026-01-04 12:45:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000100157%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001495723%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/faucets/for-manufacturer~watersaver/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K188&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K188%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tank-levels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~40-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/pipe-size~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tank-vents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001538785%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~watersaver&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K188&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K188%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-levels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000047728%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/specifications-met~asme-b16-22&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-37&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122358%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-vents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:48 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503989650348&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503989650348%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136514%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=faucets/for-manufacturer~watersaver&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K188&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K188%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-0015/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504792%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/diameter~6-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-007/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K679&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K679%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/thread-type~un-unf-sae-straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=89955K188&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2289955K188%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-0015&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000097058%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/tube-od~42-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39664 pages (at 52 pages/min), scraped 886 items (at 1 items/min)
2026-01-04 12:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~6-2millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-6255&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~34-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001466859%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feeler-gauges/thickness~0-03/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fittings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002218328%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/diameter~6-2millimeters/
2026-01-04 12:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507552%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5269K535&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225269K535%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001492755%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~34-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feeler-gauges/thickness~0-03&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/diameter~7-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~10-02-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~1-9405&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tanks/capacity-weight-~34-gal-/
2026-01-04 12:46:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~10-013-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525148%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5269K535&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225269K535%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~100-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505233%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~10-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~10-02mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/fabrication~cold-worked&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493584%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~10-02mm/
2026-01-04 12:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5269K535&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225269K535%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39713 pages (at 49 pages/min), scraped 886 items (at 0 items/min)
2026-01-04 12:47:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~100mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247071%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/feet/thread-size~m8-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/material~carbon-fiber-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~100mm/
2026-01-04 12:47:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~12-016-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5269K535&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225269K535%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003423553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shafts/thread-size~1-1-8-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001496069%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/felt-feet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=batteries/manufacturer-equivalent-number~ez8-15-200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=feet/thread-size~m8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:45 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003423553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/material~carbon-fiber-3&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:47:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3186695198062&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=batteries&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3186695198062%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078218%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/material~iron/
2026-01-04 12:47:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/feet/thread-size~m8/
2026-01-04 12:47:50 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8264408215759&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8264408215759%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459026%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:47:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/pump-tube-number~120&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/female-standoffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~1-1-8-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=felt-feet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~15-032-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7759K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227759K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002292865%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shafts/thread-size~1-1-8-8/
2026-01-04 12:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-for-sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-nozzles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9628N52&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229628N52%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39760 pages (at 47 pages/min), scraped 887 items (at 1 items/min)
2026-01-04 12:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~0-15-m/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~15-032mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fep-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~3-4-4-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~15-032mm/
2026-01-04 12:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~160-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449235%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~150-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tape-measures/length~4-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~5-8-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fep-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~15-01-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shafts/thread-size~7-16-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten-electrodes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95465A205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295465A205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001584846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455383%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2057766460678&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shafts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2057766460678%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~48&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/for-use-with~coolant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95465A205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295465A205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001598606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~15-01-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turn-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taper-locks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turnbuckles/thread-size~5-8-11-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taper-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/products/bearings/id~15-01-mm/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 12:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:07 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/products/bearings/id~15-01-mm/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: timeout'}]
2026-01-04 12:49:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39807 pages (at 47 pages/min), scraped 888 items (at 1 items/min)
2026-01-04 12:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/for-use-with~coolant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=turnbuckles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95465A205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295465A205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turning-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001598606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-15-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taper-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=turnbuckles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turnbuckles/thread-size~5-8-11-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taper-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001499826%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-2-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2227K95&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222227K95%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95465A205&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295465A205%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~1-31-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001598606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A877&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A877%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506239%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~2-3775&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sharpeners/abrasive-material~diamond&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498340%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=twisted-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~1-31-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sharps-containers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001598606%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~19-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506239%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8162074232357&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sharpeners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8162074232357%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626653%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~3-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~11mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/flute-type~spiral-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39858 pages (at 51 pages/min), scraped 890 items (at 2 items/min)
2026-01-04 12:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~19-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3705N25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223705N25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506239%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/ferrules/length~11mm/
2026-01-04 12:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/length~7-16-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~21-500mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~3-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001606475%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/flute-type~spiral&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~21-500mm/
2026-01-04 12:50:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622238%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5182K507&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225182K507%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506239%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:50:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/length~7-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/taps/flute-type~spiral/
2026-01-04 12:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/pipe-size~1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~24-9996-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=44655K27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2244655K27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ferrules/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=un-compliant-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/ferrules/length~7-16/
2026-01-04 12:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502672%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~25-05-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:50:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fh-0518-24-studs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/pipe-size~1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~25-303-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505563%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ferrules/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/plastic-unthreaded-spacers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000033831%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001494426%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6518880407998&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6518880407998%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39908 pages (at 50 pages/min), scraped 893 items (at 3 items/min)
2026-01-04 12:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fh0518-24-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheet-metal-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-3-16-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiber-back-sanding-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=unthreaded-plastic-spacers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8911K338&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228911K338%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-3-16-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=utility-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiber-back-sanding-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sheet-storage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4-0035&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/taps/thread-size~1-3-16-16/
2026-01-04 12:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shelf-boards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-raw-materials/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/belt-trade-number~680-h8m-30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493710%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5134135264830&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=v%20belts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5134135264830%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005295546%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~5-076-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coatings/formulation~shellac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-raw-materials&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-channels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=battery-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~5-7-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001504449%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 39958 pages (at 50 pages/min), scraped 894 items (at 1 items/min)
2026-01-04 12:52:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fiberglass-wrap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506394%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shellac-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~7-076-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/files/for-use-on~plaster/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A231&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A231%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~6-076-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-type~npt/pipe-size~3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fiberglass-wrap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001507199%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shields/material~carbon-fiber-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~7-076mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=files/for-use-on~plaster&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A231&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A231%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~7-076mm/
2026-01-04 12:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shields/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7794418569789&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7794418569789%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929774%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~7-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shields/material~carbon-fiber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fillers/for-use-on~fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~8-038-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A231&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A231%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:08 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~3-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/for-use-with~butane-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shields/material~carbon-fiber/
2026-01-04 12:53:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40004 pages (at 46 pages/min), scraped 894 items (at 0 items/min)
2026-01-04 12:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shields/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valve-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~7mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirator-masks/niosh-approval-number~tc-84a-0120/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~8-038-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fillers/for-use-on~fabric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shields/material~stainless-steel/
2026-01-04 12:53:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~7mm/
2026-01-04 12:53:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=96990A231&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2296990A231%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~butane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=beads/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filter-holders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5826054618903&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5826054618903%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929750%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tee-nuts/thread-size~1-2-13/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tc-84a-0120-respirator-masks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/valves/for-use-with~butane/
2026-01-04 12:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/valve-type~air-release&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9970513714292&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=beads&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9970513714292%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1604N13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221604N13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=variance-indicators/manufacturer-model-number~196b1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/for-use-with~sodium-hypochlorite-bleach/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filter-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/military-specification~ms17795-74/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-nuts/thread-size~1-2-13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9016360397335&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=variance%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9016360397335%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:57 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=valves&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308202%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/valve-type~air-release&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tee-nuts/thread-size~m42/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lock-washers/tooth-location~external/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/for-use-with~bleach&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/fitting-connection~quick-clamp-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/material~wood-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40051 pages (at 47 pages/min), scraped 895 items (at 1 items/min)
2026-01-04 12:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/military-specifications-met~ms17795-74&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/filters/for-use-with~bleach/
2026-01-04 12:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/tube-material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128377%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-nuts/thread-size~m42&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/metric-external-tooth-lock-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-565&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/military-specifications-met~ms17795-74/
2026-01-04 12:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/for-use-with~diesel-fuel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/connection-style~quick-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:25 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000128377%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/material~wood-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:54:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453388%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/metric-external-tooth-lock-washers/
2026-01-04 12:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000059603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/for-use-with~formic-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~0-6262&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tees/connection-style~quick-clamp/
2026-01-04 12:54:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/for-tube-material~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3487712981410&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3487712981410%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453388%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-nuts/thread-size~m42&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~15-20/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/for-use-with~diesel-fuel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tees/for-tube-material~copper/
2026-01-04 12:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~20-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/for-use-with~formic-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tees/for-use-with~diesel-fuel/
2026-01-04 12:54:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/filters/hvac-filter-trade-size~25-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-007&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~15-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-039&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9977791246039&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9977791246039%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964887%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/material~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tees/military-specification~ms20825-6j/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~20-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/filters/trade-size~15-20/
2026-01-04 12:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001467142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4102N51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224102N51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tees/material~stainless-steel/
2026-01-04 12:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=filters/trade-size~25-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/filters/trade-size~20-25/
2026-01-04 12:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40100 pages (at 49 pages/min), scraped 895 items (at 0 items/min)
2026-01-04 12:55:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001467142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-039&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:55:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fine-tip-markers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/specifications-met~ms20825-6j&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/filters/trade-size~25-25/
2026-01-04 12:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/finishing-wood-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-254&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tees/specifications-met~ms20825-6j/
2026-01-04 12:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/telescoping-strut-channel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=walk-through-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-189&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070600%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000010242%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fine-tip-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=finishing-wood-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shims/thickness~0-600-mm/thickness~0-6-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001466951%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-angle-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=telescoping-strut-channel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/film/material~hard-fiber-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/triple-wave-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tempered-aluminum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:55:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8155835142441&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shims&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8155835142441%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001464277%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:56:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/thickness~0-6mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fishpaper-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40149 pages (at 49 pages/min), scraped 896 items (at 1 items/min)
2026-01-04 12:56:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/thickness~0-6mm/
2026-01-04 12:56:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shims/triple-wave-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wash-guns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~12-05-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tempered-aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~13-6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~12-8-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shims/triple-wave-washers/
2026-01-04 12:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000052765%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~13-991-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000070654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~14-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shipping-boxes/shipping-standard~un4g-y19-2-s&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~15-0368-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7456722113519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shipping%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7456722113519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005066536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shipping-boxes/shipping-standard~un4gv-x20-s&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wastewater-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~13-991mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~15-0368mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/flange-od~4-21-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7456722113519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shipping%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7456722113519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005066580%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shipping-jugs/shipping-standard~cfr-title-49-for-packing-group-i&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~16-1016-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:56:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~13-991mm/
2026-01-04 12:56:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~14/
2026-01-04 12:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7456722113519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shipping%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7456722113519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005066536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:01 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~15-0368mm/
2026-01-04 12:57:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8839024928106&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shipping%20jugs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8839024928106%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001973788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/for-use-with~air/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thermal-gap-fillers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000026697%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges-for-sodium-hydroxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40197 pages (at 48 pages/min), scraped 896 items (at 0 items/min)
2026-01-04 12:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/material~fiberglass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wear-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7456722113519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shipping%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7456722113519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005066536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flanges/pipe-size~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thermal-gap-fillers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/for-use-with~sodium-hydroxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~2-1285&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shop-towels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/flanges/for-use-with~sodium-hydroxide/
2026-01-04 12:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7456722113519&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=shipping%20boxes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7456722113519%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005066536%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:57:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000041142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/pipe-size~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flared-compression-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flared-connectors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~2-754&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-bolts/thread-size~1-2-20-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982323229449&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982323229449%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050647%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flashlights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:57:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~21-989-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flat-head-self-drilling-tapping-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000076267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flared-compression-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flared-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/labels/message~this-end-up/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-bolts/thread-size~1-2-20&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40241 pages (at 44 pages/min), scraped 896 items (at 0 items/min)
2026-01-04 12:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~21-989mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flat-tip-set-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-head-self-drilling-tapping-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shoulder-bolts/thread-size~1-2-20/
2026-01-04 12:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flex-head-combination-wrenches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flex-top-expanding-locknuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~21-989mm/
2026-01-04 12:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread/material~tantalum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=this-end-up-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-27/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flat-tip-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flex-head-combination-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flex-top-expanding-locknuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~28-04-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread/material~tantalum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-screws/specifications-met~ms51575-27&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/specifications-met~ms51575-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flexible-rectangular-magnets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000150002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3913099702390&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3913099702390%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/bearing-trade-number~6217-2z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:58:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shoulder-screws/specifications-met~ms51575-27/
2026-01-04 12:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-locking-compounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:02 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3913099702390&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3913099702390%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510077%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread/material~tantalum&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 12:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003921175%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flexible-rectangular-magnets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~3-11-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floats/for-use-with~alcohol-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000150002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/specifications-met~ms51575-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40283 pages (at 42 pages/min), scraped 896 items (at 0 items/min)
2026-01-04 12:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-locking-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~3-25/od~3-1-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000165263%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/shoulder-screws/military-specification~ms51575-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000057737%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000160429%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floats/for-use-with~alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000150002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/american-wire-gauge-awg~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thread-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floats/material~magnesium/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shower-drain-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/floats/for-use-with~alcohol/
2026-01-04 12:59:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=wire&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112244%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shoulder-screws/specifications-met~ms51575-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000150002%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 12:59:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thread-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/shoulder-screws/specifications-met~ms51575-3/
2026-01-04 12:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floats/material~magnesium&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floor-drill-presses/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shut-off-fire-safety-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=shut-off-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floor-flanges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~35-043-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 12:59:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2394922483006&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2394922483006%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511207%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~33-04-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-pipe-fitting-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-drill-presses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/floor-outlet-box-flanges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40330 pages (at 47 pages/min), scraped 896 items (at 0 items/min)
2026-01-04 13:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001497307%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~35-043mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-mats/mat-type~social-distancing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~35-043mm/
2026-01-04 13:00:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/floor-mats/mat-type~social-distancing/
2026-01-04 13:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=side-stock-belting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-pipe-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rod-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rod-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=floor-outlet-box-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~38-04-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sidewalk-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicon-bronze-hex-head-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flanges/material~fiberglass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~44-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-controls/for-use-with~coolant/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rod-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rod-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/flanges/material~fiberglass/
2026-01-04 13:00:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-controls/for-use-with~diesel-fuel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~4-922&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~38-04mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:00:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-controls/for-use-with~hydraulic-fluid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~44mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000137157%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~38-04mm/
2026-01-04 13:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-controls/for-use-with~coolant&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~1-3-4-8-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~46-04-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~44mm/
2026-01-04 13:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40377 pages (at 47 pages/min), scraped 896 items (at 0 items/min)
2026-01-04 13:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-controls/for-use-with~diesel-fuel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-size~1-4-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002969065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sign-poles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-controls/for-use-with~hydraulic-fluid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162746%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/flow-controls/for-use-with~diesel-fuel/
2026-01-04 13:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~51-05-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2258N35&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222258N35%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-3-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9072876622555&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9072876622555%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sjeo-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-size~1-4-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/threaded-rods/thread-size~1-3-4-8/
2026-01-04 13:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-sensors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~72-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~51-05mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sjoow-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/thread-type~diamond/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454010%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/threading~fully-threaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~51-05mm/
2026-01-04 13:01:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-valves/valve-type~ball/shape~straight/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K701&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K701%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicon-carbide-powders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~72mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flow-valves/valve-type~ball/thread-type~bspp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:01:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/thread-type~diamond&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/threading~fully-threaded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~72mm/
2026-01-04 13:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/shape~straight&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~1-3-4-5-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394320%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40427 pages (at 50 pages/min), scraped 898 items (at 2 items/min)
2026-01-04 13:02:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-sleeves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=339191585183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B339191585183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000124163%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flow-valves/valve-type~ball/thread-type~bspp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448537%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=97825A110&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2297825A110%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~1-3-8-6-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~9-6-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~2-1-2-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=339191585183&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B339191585183%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002247047%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000037076%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90044A213&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290044A213%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-sleeves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334594%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000126494%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453144%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fluke-114-multimeters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=91251A771&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2291251A771%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screws/thread-size~3-4-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~9-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threading-lathe-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=90044A231&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2290044A231%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-food-industry-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/three-arm-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3981476179935&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=socket%20head%20cap%20screws&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3981476179935%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333406%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000159693%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:02:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluke-114-multimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-gel-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fluorocarbon-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threading-lathe-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fluoropolymer-heat-shrink-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40475 pages (at 48 pages/min), scraped 902 items (at 4 items/min)
2026-01-04 13:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=silicone-rubber-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/throttle-butterfly-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=three-arm-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000159693%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/flush-blind-rivets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/thrust-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluorocarbon-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fluoropolymer-heat-shrink-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=belt-staples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=throttle-butterfly-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000159693%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foam-grips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=flush-blind-rivets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solid-copper-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=thrust-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foam-strips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/foils/material~platinum/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000159693%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:03:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~10-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/color~black-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-grade-ball-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foam-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sink-drain-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40521 pages (at 46 pages/min), scraped 902 items (at 0 items/min)
2026-01-04 13:04:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=foils/material~platinum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sink-faucet-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~125-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1362358675308&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1362358675308%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001509979%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ties/length~2-3-16-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-grade-ball-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-housing-id~51-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/screw-size~m180/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000111075%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food-industry-lanyards/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099232%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bin-cups&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=birch-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ties/length~2-3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-screw-size~m180&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-industry-lanyards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bird-spikes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/ties/length~2-3-16/
2026-01-04 13:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/for-use-with~food/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=black-beauty-blasting-media&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:04:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/for-screw-size~m180/
2026-01-04 13:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/food/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stickers/shape~footprint/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/timer-switches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~48-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tin-coated-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40569 pages (at 48 pages/min), scraped 902 items (at 0 items/min)
2026-01-04 13:05:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bladder-tanks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000065905%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=food&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=footprint-stickers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=timer-switches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/precision-knife-blade-type~curve-cutting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tin-coated-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/shape~round/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982658580091&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blades&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982658580091%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034437%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/four-way-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blades/precision-knife-blade-type~curved-for-contouring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/framing/system-of-measurement~metric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-bar-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/for-housing-id~91-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9982658580091&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blades&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9982658580091%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034286%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/shape~ring&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/framing-systems/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000148096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-hex-head-pipe-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=four-way-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:05:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308142%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/freeze-protection-space-heaters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971113029698&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971113029698%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=framing-systems&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40616 pages (at 47 pages/min), scraped 902 items (at 0 items/min)
2026-01-04 13:06:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-hex-head-pipe-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/studs/material~grade-2-titanium/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/titanium-with-material-certification/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blowers/motor-enclosure-type~open&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=freeze-protection-space-heaters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tivar-hot/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~tl-2300/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9955125964573&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blowers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9955125964573%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-studs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-with-material-certification&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:44 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9955125964573&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blowers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9955125964573%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002141885%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blowers/motor-enclosure-type~open&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:06:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tivar-hot&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bnc-adapter-tees&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:06:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-loaded-seals/for-use-with~oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boiler-adhesives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slip-on-framing-caster-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/current~2-1-2-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9759667665353&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spring%20loaded%20seals&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9759667665353%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slip-on-framing-rail-ends&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boiler-cleaners%252fconditioners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/current~32-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boilers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40665 pages (at 49 pages/min), scraped 902 items (at 0 items/min)
2026-01-04 13:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuses/current~50-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~2-5a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~32a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~2-375/length~2-3-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=fuses/current~50a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=slotted-angle-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fuses/current~2-5a/
2026-01-04 13:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/finish~copper-plated-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~2-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fuses/current~32a/
2026-01-04 13:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/finish~nickel-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/fuses/current~50a/
2026-01-04 13:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tooling-component-hand-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001597104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001585548%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~2-375inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bolts/military-specification~ms51575-25/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tooling-plates/material~plastic-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001519486%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/galvanized-iron-pipe-fitting-plugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001545251%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/finish~copper-plated-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:07:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~2-375inches/
2026-01-04 13:07:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tooling-component-hand-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~35-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torlon-plates/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/military-specifications-met~ms51575-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tooling-plates/material~plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=galvanized-iron-pipe-fitting-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~3-25/length~3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40715 pages (at 50 pages/min), scraped 902 items (at 0 items/min)
2026-01-04 13:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=small-od-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bolts/military-specifications-met~ms51575-25/
2026-01-04 13:08:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tooling-plates/material~plastic/
2026-01-04 13:08:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~1-8-41-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627220%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001630299%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~35millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torlon-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gas-meters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/torque-wrench-adapters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~7-5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454370%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~35millimeters/
2026-01-04 13:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bolts/thread-size~2-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gas-spring-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001605325%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/snap-gauges/certificate-type~calibration-certificate-traceable-to-nist/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/color~amber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6350K685&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226350K685%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gas-meters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torque-wrench-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bomb-samplers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gas-spring-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snap-gauges/certification~calibration-certificate-traceable-to-nist&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/color~amber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bore-gauges/manufacturer~starrett-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/snap-gauges/certification~calibration-certificate-traceable-to-nist/
2026-01-04 13:09:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001548139%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40765 pages (at 50 pages/min), scraped 903 items (at 1 items/min)
2026-01-04 13:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snow-scrapers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=snow-stakes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soap-cartridges/manufacturer~kimberly-clark&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/totes/capacity~64-fl-oz/capacity~1-2-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bore-gauges/manufacturer-model-number~579d&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/for-use-with~methane/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=191095061359&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bore%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B191095061359%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002267107%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6001887424639&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=soap%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6001887424639%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002270564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=191095061359&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bore%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B191095061359%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096612%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/socket-extensions/sold-as~set/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/for-use-with~methane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bore-micrometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bore-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bore-through-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6342366933521&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6342366933521%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455379%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=totes/capacity-weight-~64-fl-oz-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6001887424639&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=soap%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6001887424639%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002270564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=191095061359&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bore%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B191095061359%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096612%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965661%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/totes/capacity-weight-~64-fl-oz-/
2026-01-04 13:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/strand-type~double&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:09:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-extension-sets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/track-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001982301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6001887424639&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=soap%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6001887424639%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002270564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=191095061359&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bore%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B191095061359%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096612%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965661%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-drive-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bosch-rotozip-spiral-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40816 pages (at 51 pages/min), scraped 903 items (at 0 items/min)
2026-01-04 13:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=socket-head-cap-screw-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/thickness~0-025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=track-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tracks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6001887424639&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=soap%20cartridges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6001887424639%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002270564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:10:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=191095061359&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bore%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B191095061359%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096612%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965661%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gaskets/width~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/thickness~0-025&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/fitting-connection~flanged/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity~3-1-2-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-cam-locks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tracks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity~7-1-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001460380%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-cup-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:48 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965661%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7034539236718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bottles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7034539236718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gaskets/width~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7034539236718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bottles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7034539236718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/transformers/voltage~12v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/connection-style~flanged&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/for-use-with~alcohol-based-solvents/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5176T27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225176T27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/for-use-with~ammonia/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9639739499351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9639739499351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000015849%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bottles/capacity~475-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/connection-style~flanged/
2026-01-04 13:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40861 pages (at 45 pages/min), scraped 903 items (at 0 items/min)
2026-01-04 13:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=transformers/voltage~12v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/for-use-with~alcohol-based-solvents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/for-use-with~ammonia&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/maximum-pressure~300-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-gear-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottles/capacity-weight-~475-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=803742726147&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B803742726147%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553683%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/traps/for-use-with~hydrochloric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003179269%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soft-iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965242%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bottom-dumping-dump-buckets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-funnels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bottles/capacity-weight-~475-ml/
2026-01-04 13:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3891N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223891N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3813K5&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223813K5%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/maximum-pressure-psi~300-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solder/performance~conductive-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=traps/for-use-with~hydrochloric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001731667%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:11:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=box-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/maximum-pressure~8600-psi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-pipe-nipples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measures~carbon-monoxide-level/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9967172976307&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9967172976307%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/push-to-close-latches/material~stainless-steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=box-wagons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40908 pages (at 47 pages/min), scraped 906 items (at 3 items/min)
2026-01-04 13:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder/electrical-properties~conductive&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8995T21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228995T21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-pipe-routing-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/maximum-pressure-psi~8600-psi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measures~inside/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solder/electrical-properties~conductive/
2026-01-04 13:12:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measures~line-width/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~carbon-monoxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-push-to-close-latches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001717092%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-raised-face-pipe-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/measures~carbon-monoxide/
2026-01-04 13:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/brackets/screw-size~no-7/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~inside-measurement&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-rolling-platform-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/measures~line-widths&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measurement-unit~feet/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-sheet-metal-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/measurement-unit~yards-per-minute/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/unit-of-measure~gf-cm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001717092%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/measures~inside-measurement/
2026-01-04 13:12:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/measures~line-widths/
2026-01-04 13:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/for-screw-size~no-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:12:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/brackets/for-screw-size~no-7/
2026-01-04 13:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gauges/thread-type~npsm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/scale~ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/system-of-measurement~cm-g&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 40954 pages (at 46 pages/min), scraped 907 items (at 1 items/min)
2026-01-04 13:13:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brake-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/scale~yd-min&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-tags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/scale~ft-/
2026-01-04 13:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001717092%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-lug-assortments&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/system-of-measurement~cm-g/
2026-01-04 13:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-tapping-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gauges/scale~yd-min/
2026-01-04 13:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-threaded-balls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gauges/thread-type~npsm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trim/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151504%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2773767270124&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2773767270124%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001717092%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-thumb-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=branding-markers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-toggle-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6744N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226744N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gearmotors/voltage~230v-ac/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-paste&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trim&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solder-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-alloy-260-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gears/material~bronze-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/soldering-flux/military-specification~dod-std-1866/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/barbed-fittings/barb-style~standard/for-use-with~citric-acid already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacer-caps/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41001 pages (at 47 pages/min), scraped 908 items (at 1 items/min)
2026-01-04 13:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-compression-tube-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glass-beads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soldering-flux/for-joining~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solenoids/duty-cycle~intermittent/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gears/material~bronze&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoid-din-connectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soldering-flux/military-specifications-met~dod-std-1866&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8447550327730&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=soldering%20flux&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8447550327730%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454186%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-barbed-fittings-for-chemical-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-spacer-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/gears/material~bronze/
2026-01-04 13:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glass-beads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/soldering-flux/military-specifications-met~dod-std-1866/
2026-01-04 13:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7765A16&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227765A16%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/duty-cycle-rating~intermittent&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/for-use-with~beverage&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solenoids/for-use-with~diesel-fuel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002142343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967788%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brazing-alloys/aws-material-code~bcup-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~9-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/for-use-with~hydraulic-fluid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/for-use-with~methanol-methyl-alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5077T28&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225077T28%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7166471187711&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brazing%20alloys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7166471187711%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004986364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brazing-flux/specifications-met~aws-a5-31-type-fb3d&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/for-use-with~diesel-fuel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=standoffs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002984290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stanley-10-399-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41053 pages (at 52 pages/min), scraped 910 items (at 2 items/min)
2026-01-04 13:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7795A14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227795A14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7687960159964&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brazing%20flux&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7687960159964%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004973861%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solenoids/for-use-with~diesel-fuel/
2026-01-04 13:15:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4728407233061&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=standoffs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4728407233061%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334596%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standoffs/thread-size~9-16-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:15:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solenoids/for-use-with~steam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glides/mount-type~slip-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brazing-torches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glides/mount-type~threaded-stud/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968293%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/tube-od~16-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/breakers/current~125-amp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/tube-od~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47905K83&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247905K83%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers/current~10-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glides/mount-type~slide-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glides/mount-type~threaded-stud&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-tube-od~16mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers/current~125a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8180085661429&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=breakers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8180085661429%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001514240%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-tube-od~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9952801634820&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9952801634820%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010570%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9952801634820&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9952801634820%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010668%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breakers/current~45-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:15:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tube-fittings/for-tube-od~16mm/
2026-01-04 13:15:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pumps/for-use-with~soluble-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/breakers/current~125a/
2026-01-04 13:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7026K612&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227026K612%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:02 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tube-fittings/for-tube-od~8/
2026-01-04 13:16:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8180085661429&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=breakers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8180085661429%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=168950821422&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solenoids&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B168950821422%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:16:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/id~4-000-mm/id~4-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41100 pages (at 47 pages/min), scraped 913 items (at 3 items/min)
2026-01-04 13:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/thickness~0-0035/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/for-use-with~calcium-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/thickness~0-015/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6608T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226608T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvent-neutralizer-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gloves/thickness~0-028/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~laminate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/id~4mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/thickness~0-0035&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/for-use-with~calcium-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gloves/thickness~0-015&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=966787406552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solvents&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B966787406552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/id~4mm/
2026-01-04 13:16:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bristol-key-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001456029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967856%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2023183652164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2023183652164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001459678%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~plastic-1/for-use-on~polypropylene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-gear-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/for-use-on~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9359N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229359N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5415T36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225415T36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-gears&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=966787406552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=solvents&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B966787406552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930441%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/solvents/for-use-on~plastic-1/for-use-on~pvc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:16:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fittings/thread-type~universal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-hemispheres&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/for-use-on~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41149 pages (at 49 pages/min), scraped 915 items (at 2 items/min)
2026-01-04 13:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-manifolds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=solvents/for-use-on~pvc-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9359N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229359N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/glue/for-use-on~aluminum/
2026-01-04 13:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bronze-alloy-385-angles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fittings/thread-type~universal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-machine-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=soss-hinges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/solvents/for-use-on~pvc-plastic/
2026-01-04 13:17:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-manifolds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9359N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229359N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-storage-racks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sound-control-panels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-supports/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/formulation~urethane-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sound-control-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/space-heaters/environment~hazardous/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:55 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9359N14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229359N14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~14200/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-storage-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/color~green-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/formulation~urethane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/color~yellow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brother-tze651-label-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=space-heaters/environment-1~hazardous&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41196 pages (at 47 pages/min), scraped 915 items (at 0 items/min)
2026-01-04 13:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081541%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~14200&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/space-heaters/environment-1~hazardous/
2026-01-04 13:18:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/color~green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002108255%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/color~yellow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/finish~nickel-chrome-plated&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/for-use-with~acetone/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7091553161552&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7091553161552%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000132758%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:18:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/tubing/color~green/
2026-01-04 13:18:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bs-228-roller-chain-links&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7524A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227524A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002054357%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/for-use-with~pharmaceuticals/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/for-use-with~nitric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~acetone&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bucket-mixers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7524A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227524A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~332/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:18:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965604%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~nitric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckets/capacity~4-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/buckets/capacity~9-1-2-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41244 pages (at 48 pages/min), scraped 915 items (at 0 items/min)
2026-01-04 13:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7524A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227524A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~332&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~0-530/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002127247%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity-weight-~4-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stops/mounting-location~through-wall/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buckets/capacity-weight-~9-1-2-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7524A4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227524A4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~4902/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1700A29&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221700A29%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/buckets/capacity-weight-~4-gal-/
2026-01-04 13:19:39 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/buckets/capacity-weight-~9-1-2-gal-/
2026-01-04 13:19:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/screw-size~m39/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/id~2-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~603/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bearings/od~1-25/od~1-1-4-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stops/mount-type~through-wall&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bulkheads/for-use-with~sodium-carbonate-soda-ash/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~4902&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/material~cardboard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/stops/mount-type~through-wall/
2026-01-04 13:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002145877%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/for-screw-size~m39&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~2-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~603&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9733419879211&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=straps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9733419879211%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511131%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~737/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41289 pages (at 45 pages/min), scraped 916 items (at 1 items/min)
2026-01-04 13:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkheads/for-use-with~sodium-carbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=74795A397&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2274795A397%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/for-screw-size~m39/
2026-01-04 13:20:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498230%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002132008%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bearings/od~1-1-4/
2026-01-04 13:20:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bulkheads/for-use-with~sodium-carbonate/
2026-01-04 13:20:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pipe/threading~unthreaded/pipe-schedule~xxh/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~77/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:29 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123465%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~737&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~847/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~9082/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~0-165/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148364%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=svo-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=super-thick-wall-steel-(schedule-xxh)-unthreaded-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulldog-snips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumper-kits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~77&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7587A25&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227587A25%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~847&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~9082&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~0-165&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~0-197/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002085973%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~dp810/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002136575%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000091491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7610A37&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227610A37%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~e-00ns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41335 pages (at 46 pages/min), scraped 918 items (at 2 items/min)
2026-01-04 13:21:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/screw-size~m7-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7509A67&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227509A67%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7628A61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227628A61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5560K13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225560K13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~0-197&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454098%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~10-5-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~dp810&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~e-00ns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000112524%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454098%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/screw-size~m7-1&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:36 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7150684641693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bumpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7150684641693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~3-8-24&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~ea-3473/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002152011%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002099041%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:42 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000112524%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~0-197&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~10-5-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~2-88/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/shape~doughnut&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7467A127&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227467A127%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bungee-cord-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~mr-2000/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6430A17&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226430A17%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bungee-cord-end-tabs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000121310%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002311290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~ea-3473&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~2-88&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=52945K47&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2252945K47%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:06 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2632900905686&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spacers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2632900905686%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002311290%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/shape~doughnut&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~pc-7222/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002087005%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/od~5-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~mr-2000&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/thread-size~2-933-12-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41382 pages (at 47 pages/min), scraped 924 items (at 6 items/min)
2026-01-04 13:22:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000032971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~vc-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002121034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-voltage~250v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/glue/manufacturer-model-number~ww30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1831T36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221831T36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing-diameter-gauges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~pc-7222&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~5-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spacers/thread-size~2-933-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001634298%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~vc-3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~0-969-32-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/spacers/thread-size~2-933-12/
2026-01-04 13:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=glue/manufacturer-model-number~ww30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002135680%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-diameter-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gore-gasket-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clothing/material~gore-tex-pyrad-fabric/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5971K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225971K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=582295881700&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B582295881700%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002095019%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=go%252fno-go-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/profile~raised-grid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~0-969-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7354A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227354A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/spacers/washer-type~tab/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gore-gasket-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41426 pages (at 44 pages/min), scraped 926 items (at 2 items/min)
2026-01-04 13:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gore-tex-clothing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/thread-size~0-969-32/
2026-01-04 13:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5971K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225971K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/drive-size~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing-wrap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubs/material~cardboard/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7354A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227354A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9944536682256&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20handles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9944536682256%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488329%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5971K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225971K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-wrap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubs/material~cardboard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~1-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~1-64&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7354A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227354A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~2-360-18-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6355627529093&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6355627529093%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511131%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448476%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5971K14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225971K14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:23:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/round-stock/material~tungsten-carbide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~2-548-18-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:23:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=95365A135&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2295365A135%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=91732A004&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2291732A004%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:04 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7354A21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227354A21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451756%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41477 pages (at 51 pages/min), scraped 928 items (at 2 items/min)
2026-01-04 13:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m140&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tungsten-carbide-rounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~m17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=speaker-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451255%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-slotted-framing-rails/t-slotted-framing-rail-profile~single&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8821491978506&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bushings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8821491978506%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002448786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-g-10-garolite-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=speakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t6-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t8-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/pneumatic-tanks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001469376%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/expansion-tanks-for-water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/turnbuckles/thread-size~3-4-10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-le-laminate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-g-10-garolite-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/asme-code-compressed-air-storage-tanks-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001469376%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bussmann-type-gdc-fuses&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grade-m2-tool-steel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~105-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/expansion-tanks-for-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=turnbuckles/thread-size~3-4-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%229657830817246%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-le-laminate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/graduated-plastic-bottles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/expansion-tanks-for-water/
2026-01-04 13:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41523 pages (at 46 pages/min), scraped 928 items (at 0 items/min)
2026-01-04 13:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9888K9&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229888K9%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001469376%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grade-m2-tool-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001622853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~105-ft&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:25:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/length~75-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=graduated-plastic-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=button-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:35 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988135953728&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20slotted%20framing%20rails&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988135953728%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001469376%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx108/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624389%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~bspt/pipe-size~3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx44/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/manufacturer~tri-flow/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000119922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx68/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx108-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/two-line-clamps already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spiral-shank-nails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx44-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/belt-trade-number~bx81/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/manufacturer~tri-flow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3217042704133&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3217042704133%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334890%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bx68-v-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:11 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000142617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000136564%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-type~npt/pipe-size~3-1-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:26:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/two-line-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41570 pages (at 47 pages/min), scraped 929 items (at 1 items/min)
2026-01-04 13:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002278421%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~mobil-dte-10-excel-22/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/split-pin-insert-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~mobilgear-600-xp-220/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=temperature-switches/enclosure-rating~nema-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=terminal-blocks/number-of-circuits~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2079N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222079N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/split-pin-insert-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/u-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=830330883100&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=temperature%20switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B830330883100%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000062576%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=two-line-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1456977575902&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=terminal%20blocks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1456977575902%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554434%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/products/split-pin-insert-tools/> (failed 3 times): Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 13:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~mobil-dte-10-excel-22&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:37 [scrapy.core.scraper] (PID: 126) ERROR: Error downloading <GET https://www.mcmaster.com/products/split-pin-insert-tools/>
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/defer.py", line 2013, in _inlineCallbacks
    result = context.run(
             ^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/twisted/python/failure.py", line 467, in throwExceptionIntoGenerator
    return g.throw(self.value.with_traceback(self.tb))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/downloader/middleware.py", line 68, in process_request
    return (yield download_func(request, spider))
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
scrapy.core.downloader.handlers.http11.TunnelError: Could not open CONNECT tunnel with proxy brd.superproxy.io:22225 [{'status': 502, 'reason': b'Proxy Error: server_error Error creating ext request: TUN_ERR: Bad options: Requested IP not found in the proxy pool'}]
2026-01-04 13:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~mobilgear-600-xp-220&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=split-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081731%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=u-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/uhmw-polyethylene-discs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002081677%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~synxtreme-hd-1-220/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K965&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K965%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spoilboards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:26:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2158K86&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222158K86%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/threaded-rods/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rod-mounting-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grease/trade-name~tapmatic-natural/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=uhmw-polyethylene-discs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~synxtreme-hd-1-220&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41617 pages (at 47 pages/min), scraped 932 items (at 3 items/min)
2026-01-04 13:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122208%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=threaded-rods/material~steel-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grease/trade-name~tapmatic-natural&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~16-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~16-34&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-bottles/capacity~1-1-2-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/threaded-rods/material~brass/
2026-01-04 13:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=10175K21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2210175K21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tig-torch-insulators/torch-series-number~17&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7151885265529&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=threaded%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7151885265529%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000099520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7669763092888&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7669763092888%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002090905%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ultraviolet-flashlights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561130%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562279%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=220833974646&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20bottles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B220833974646%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002096023%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinders/for-use-with~cup-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3723043706875&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tig%20torch%20insulators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3723043706875%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002115553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9936K89&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229936K89%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinders/for-use-with~wheel-brushes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/underground-electrical-enclosures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ultraviolet-flashlights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7394K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227394K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~22-15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:27:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/for-use-with~cup-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~24-25&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~26-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/for-use-with~wheel-brushes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=underground-electrical-enclosures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinders/manufacturer-model-number~487-0066/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41668 pages (at 51 pages/min), scraped 934 items (at 2 items/min)
2026-01-04 13:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=titanium-squares&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001560914%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7394K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227394K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967681%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/for-use-with~cup-brushes&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4514N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224514N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/cable-awg~28-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/for-use-with~wheel-brushes&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/manufacturer-model-number~487-0066&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinders/manufacturer-model-number~dwe4887/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561840%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002143133%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7394K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227394K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-nozzles/material~316l-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinders/manufacturer-model-number~dwe4887&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6778563655339&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6778563655339%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561840%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7394K32&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227394K32%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7765984901538&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7765984901538%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002074736%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:28:58 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6778563655339&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20nozzles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6778563655339%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510786%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-nozzles/material~316l-stainless-steel&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:29:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/od~7-025-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~crown-bright-beige&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562720%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torlon-square-stock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562769%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41720 pages (at 52 pages/min), scraped 935 items (at 1 items/min)
2026-01-04 13:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561840%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500483%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=torx-self-drilling-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/cable-designation~mg/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002190122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/diameter~7-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spray-paint/color~international-harvester-red&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grinding-wheels/for-use-on~diamond-wheels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5212847902408&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=spray%20paint&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5212847902408%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002203327%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001561840%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:29:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-joint-rod-ends/lubrication~not-required/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500483%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/industry-designation~mg&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/diameter~7-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity~24-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/external-power-supply-efficiency-standard~doe-level-vi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grinding-wheels/for-use-on~diamond-wheels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:44 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/industry-designation~mg/
2026-01-04 13:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity~6-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000149734%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8168905638803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trash%20cans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8168905638803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002103416%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9626962926004&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9626962926004%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929956%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/rod-ends-and-linkages/lubrication-free-ball-joint-rod-ends-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500483%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trash-cans/capacity~31-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8168905638803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trash%20cans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8168905638803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101404%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity~8-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/specifications-met~doe-level-vi-efficiency&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grip-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable/american-wire-gauge-awg~30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8168905638803&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trash%20cans&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8168905638803%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082852%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/specifications-met~doe-level-vi-efficiency/
2026-01-04 13:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41767 pages (at 47 pages/min), scraped 935 items (at 0 items/min)
2026-01-04 13:30:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001500483%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:30:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/outer-circumference~150/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trash-cans/capacity-weight-~31-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fitting-gaskets/tube-od~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=trim/profile-shape~h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/outer-circumference~191/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-brakes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/trash-cans/capacity-weight-~31-gal-/
2026-01-04 13:30:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/v-belts/outer-circumference~23-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-gauge~30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grip-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948496004712&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=trim&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948496004712%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000098157%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~150inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/hole-diameter~0-36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable/wire-gauge~30/
2026-01-04 13:30:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fitting-gaskets/for-tube-od~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tube-fitting-gaskets/tube-od~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~191inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/v-belts/outer-circumference~150inches/
2026-01-04 13:30:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v-belts/outer-circumference~23-5inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:47 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tube-fitting-gaskets/for-tube-od~2/
2026-01-04 13:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/v-belts/outer-circumference~191inches/
2026-01-04 13:30:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/for-hole-diameter~0-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/v-belts/outer-circumference~23-5inches/
2026-01-04 13:30:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grommets/hole-diameter~5-2-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:30:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-loaded-casters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~v394/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fitting-gaskets/tube-od~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tube-fitting-gaskets/for-tube-od~6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bearings/system-of-measurement~metric&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/grommets/for-hole-diameter~0-36/
2026-01-04 13:31:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-security-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1768933986141&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tube%20fitting%20gaskets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1768933986141%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001471874%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:11 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tube-fitting-gaskets/for-tube-od~6/
2026-01-04 13:31:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41814 pages (at 47 pages/min), scraped 935 items (at 0 items/min)
2026-01-04 13:31:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=935780893697&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=bearings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B935780893697%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001498488%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-platform-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grommets/for-hole-diameter~5-2mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=v394-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/grooved-flanges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=43315K57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2243315K57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-plunger-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/grommets/for-hole-diameter~5-2mm/
2026-01-04 13:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-cups-for-robotics/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bells&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tubing/fitting-connection~quick-disconnect/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/guards/material~ceramic-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=grooved-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~12-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~150-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-cups-for-robotics&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=spring-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001618526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/fitting-connection~quick-disconnect-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guards/material~ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:31:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~2-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/for-use-with~stainless-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/fitting-connection~quick-disconnect-1/
2026-01-04 13:32:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/guide-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/guards/material~ceramic/
2026-01-04 13:32:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tubing/for-use-with~stainless-steel/
2026-01-04 13:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bench-and-pedestal-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41863 pages (at 49 pages/min), scraped 936 items (at 1 items/min)
2026-01-04 13:32:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vacuum-tube-caps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/gum-foam/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-number~gx24q-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/h-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~0-077&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=guide-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-tool-indicators/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505644%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vacuum-tube-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gum-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=gx24q-4-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8987K31&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228987K31%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/halogen-work-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=haimer-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/fitting-connection~flared-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001594453%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:32:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cable-ties/military-specification~ms3367-23/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:32:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/length~7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=halogen-work-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/fitting-connection~unthreaded/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41906 pages (at 43 pages/min), scraped 937 items (at 1 items/min)
2026-01-04 13:33:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:12 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:33:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/connection-style~flared&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/overall-length~1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/military-specifications-met~ms3367-23&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501042%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~13-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/valves/connection-style~flared/
2026-01-04 13:33:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000032125%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cable-ties/military-specifications-met~ms3367-23/
2026-01-04 13:33:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammers/head-weight~16-oz/head-weight~1-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/connection-type~press-in&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/for-use-with~aluminum-chloride/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/overall-length~2-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:34 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000032125%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/overall-length~1-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:33:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammers/head-weight~12-oz/head-weight~3-4-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/for-use-with~chlorinated-water/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/valves/connection-type~press-in/
2026-01-04 13:33:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000112767%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hammers/head-weight~44-oz/head-weight~2-3-4-lb/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~1-lbs-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/for-use-with~fuel-oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~aluminum-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000112767%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-ties/overall-length~2-1-4&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:33:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~12-oz-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~chlorinated-water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hammers/head-weight~1-lbs-/
2026-01-04 13:33:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:33:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hammers/head-weight~2-3-4-lbs-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hammers/head-weight~12-oz-/
2026-01-04 13:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965499%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:06 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8347067787852&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable%20ties&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8347067787852%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001624542%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:34:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/for-use-with~hydrogen/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/for-use-with~hydrochloric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~fuel-oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5007K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225007K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:10 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hammers/head-weight~2-3-4-lbs-/
2026-01-04 13:34:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 41954 pages (at 48 pages/min), scraped 937 items (at 0 items/min)
2026-01-04 13:34:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967178%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~16-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~3-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~hydrogen&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~16-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~hydrochloric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502339%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:34:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caged-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001501588%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967523%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/for-use-with~toluene-methylbenzene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~16-5millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/handle-style~knob/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calcium-hydroxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~16-5millimeters/
2026-01-04 13:34:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/handle-style~lever/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:34:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/for-use-with~toluene&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/handle-type~standard-with-ratchet-opening/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/handle-style~knob&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/pipe-size~1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/id~5-000-mm/id~5-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/valves/for-use-with~toluene/
2026-01-04 13:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969613%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42001 pages (at 47 pages/min), scraped 938 items (at 1 items/min)
2026-01-04 13:35:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/handle-style~lever&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001505391%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001506957%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hand-sanitizer-dispensers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calibration-certificate-go%252fno-go-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/handle-type~standard-with-ratchet-opening&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/pipe-size~1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969771%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924926%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144603%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hand-sanitizer-dispensers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:36 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001595225%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:35:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/thread-type~nh-nst/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7031T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227031T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002963068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:35:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calibration-rods/manufacturer-model-number~234a-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handles/mount-type~grooved-clamp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calibration-rods/manufacturer-model-number~234a-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handles/mount-type~unthreaded-stud/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~29-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5706044968213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calibration%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5706044968213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122660%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/springs/length~3-063/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5706044968213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=calibration%20rods&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5706044968213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002123284%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:35:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/thread-type~nh-nst&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7031T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227031T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/mount-type~grooved-clamp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/od~1-25-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/mount-type~unthreaded-stud&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9394720567812&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9394720567812%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000038314%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~29-5millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42047 pages (at 46 pages/min), scraped 938 items (at 0 items/min)
2026-01-04 13:36:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010700%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~3-063inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handrail-signs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000151527%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:19 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~29-5millimeters/
2026-01-04 13:36:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7031T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227031T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/springs/length~3-063inches/
2026-01-04 13:36:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/handrail-tube-fittings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~3-47&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984002022255&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984002022255%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handles/mount-type~unthreaded-stud&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:36:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9118T4&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229118T4%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hang-tags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615724%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handrail-signs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bit-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:40 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7031T11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227031T11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:36:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=handrail-tube-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bit-holders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~38-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hangers/mounting-location~over-door/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hang-tags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vented-cap-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hangers/mounting-location~vehicle/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:36:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing/temper-rating~hard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hanging-lights/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001627083%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~38-mm&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:37:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2980143699607&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tubing&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2980143699607%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002296864%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hangers/mounting-location~over-door&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42095 pages (at 48 pages/min), scraped 939 items (at 1 items/min)
2026-01-04 13:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tubing-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hard-temper-wire/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vented-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=black-oxide-stainless-steel-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vents/for-use-with~kerosene/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hangers/mounting-location~vehicle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994990758148&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994990758148%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002380881%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hanging-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hardwood-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994990758148&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994990758148%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002381218%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1728A91&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221728A91%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hard-temper-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vermiculite-gaskets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vents/shape~cap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1031N51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221031N51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=camera-cases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hardwood-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hazard-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hazardous-material-storage-cabinets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=uhmw-polyethylene-liners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vermiculite-gaskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=springs/length~7-5/length~7-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vents/shape~cap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:37:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cap-nuts/thread-size~1-12-3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vibration-damping-compounds/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2891885695101&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=springs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2891885695101%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001601754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621748%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2491040633414&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2491040633414%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004757507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazard-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hazardous-material-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42139 pages (at 44 pages/min), scraped 941 items (at 2 items/min)
2026-01-04 13:38:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/valves/connects-to~tube-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-sealer-tape/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprinkler-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cap-nuts/thread-size~1-12-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-shrink-tubing/performance~high-temperature-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vibration-isolating-bobbins/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibration-damping-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=valves/connects-to~tube&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cap-nuts/thread-size~1-12-1/
2026-01-04 13:38:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heaters/heater-type~dolly/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-sealer-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/heat-sealers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bleed-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/valves/connects-to~tube/
2026-01-04 13:38:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/victor-400-series-oxyacetylene-welding-supplies/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-shrink-tubing/high-temperature-heat-shrink-tubing-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibration-isolating-bobbins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vinyl-cleaners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helical-insert-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heaters/heater-type~dolly&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=heat-sealers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8375494534240&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8375494534240%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%229322295807263%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:38:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blind-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=victor-400-series-oxyacetylene-welding-supplies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9258402983590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9258402983590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968587%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9906T101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229906T101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helical-sti-tools/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vibra-tite-threadlockers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vinyl-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42183 pages (at 44 pages/min), scraped 941 items (at 0 items/min)
2026-01-04 13:39:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helical-insert-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/thread-size~12-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/thread-size~5-16-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/helicoils/thread-size~m2-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helical-sti-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hemostat-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/id~16-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carbide-tool-sharpeners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~12-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blowers/inlet-diameter~3-3-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~5-16-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blowers/ul-file-number~e493872&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7051711979057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7051711979057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334663%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=helicoils/thread-size~m2-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9955125964573&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blowers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9955125964573%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004921670%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hemostat-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vises/for-machine-type~surface-grinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~16mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7051711979057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7051711979057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9955125964573&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blowers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9955125964573%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004759654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7051711979057&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7051711979057%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334501%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9955125964573&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blowers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9955125964573%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004921670%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blowers/inlet-diameter~3-3-8&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:39:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=warning-light-audible-alarms&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:39:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/id~16mm/
2026-01-04 13:40:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9955125964573&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=blowers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9955125964573%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004759654%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blowers/ul-file-number~e493872&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:40:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-drivers/driver-style~driver/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-flange-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vises/for-machine-type~surface-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42230 pages (at 47 pages/min), scraped 942 items (at 1 items/min)
2026-01-04 13:40:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carpenters-chalk/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~2-812&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/color~white&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7755808933160&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7755808933160%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001934662%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=blue-tempered-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001493467%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carpenters-chalk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-drivers/driver-style~driver&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/id~58-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536223%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-flange-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:30 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7755808933160&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7755808933160%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001934662%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vises/for-machine-type~surface-grinders&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:40:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carpenters%27-chalk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313060%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001502189%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-nuts-for-low-strength-anchor-bolts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-shank-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m13-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2696N27&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222696N27%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m2-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hex-washer-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carriage-bolts/thread-size~7-8-9&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313060%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:40:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-nuts-for-low-strength-anchor-bolts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5427237301511&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=carriage%20bolts&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5427237301511%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333387%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-shank-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m13&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hexagonal-collets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m2-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hex-washer-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42278 pages (at 48 pages/min), scraped 943 items (at 1 items/min)
2026-01-04 13:41:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m3-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313060%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/for-screw-size~m13/
2026-01-04 13:41:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/for-screw-size~m2-2/
2026-01-04 13:41:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m4-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/vulcanized-fiber-rods/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/keyway-width~20-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m3-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cast-acrylic-cutters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:34 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2653472997099&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2653472997099%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313060%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:41:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cast-aluminum-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cast-iron-breather-vent-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=vulcanized-fiber-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/for-screw-size~m3-5/
2026-01-04 13:41:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m4-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wall-outlets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/wheel-diameter~6-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/keyway-width~20mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/washers/for-screw-size~m4-2/
2026-01-04 13:41:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinge-stops/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/number-of-teeth~44&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=casters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001922704%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:41:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/keyway-width~20mm/
2026-01-04 13:42:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/adjustable-hinges/mounting-holes~with-holes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ball-joint-linkages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001517006%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wall-outlets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casting-compound-mold-releases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8786T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228786T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42324 pages (at 46 pages/min), scraped 943 items (at 0 items/min)
2026-01-04 13:42:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinge-stops&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/adjustable-hinges-with-holes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~asme-standard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=water-submersible-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/ball-joint-linkages-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/swivel-joints/lubrication~not-required/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/mounting-location~half-mortise/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/chain-standard~ansi/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%221579700445496%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%229495356926942%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wedge-base-light-bulbs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~11-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=13675A51&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2213675A51%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=60645K211&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2260645K211%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-trade-number~120h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/mounting-style~half-mortise&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-standard~ansi&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-trade-number~160&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000163369%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hinges/mounting-style~half-mortise/
2026-01-04 13:42:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/roller-chain-standard~ansi/
2026-01-04 13:42:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/lubrication-free-swivel-joints&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:42:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~2-3-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127722%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~22-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/color~light-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%223511710851843%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/color~maroon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceiling-fan-speed-controls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42370 pages (at 46 pages/min), scraped 946 items (at 3 items/min)
2026-01-04 13:43:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~2-3-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=63195K11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2263195K11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceiling-wire&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127722%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~22mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sprockets/roller-chain-trade-number~40-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/color~light-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/color~maroon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103199%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hinges/overall-width~22mm/
2026-01-04 13:43:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002202371%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196457%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2434K519&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222434K519%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hinges/overall-width~8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127722%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sprockets/roller-chain-trade-size~40-2ss&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=washers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002051749%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:43:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cement/for-use-on~plastic-1/for-use-on~pvc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/sprockets/roller-chain-trade-size~40-2ss/
2026-01-04 13:43:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m135/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m15/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~0-3125inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2960338757520&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cement&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2960338757520%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930351%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929628%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:43:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hinges/overall-width~8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5503183657331&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=sprockets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5503183657331%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000127722%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:44:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/screw-size~m36/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/sanding-rolls/abrasive-material~ceramic-alumina/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~0-3125inches/
2026-01-04 13:44:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=center-marking-punches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2694067320625&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2694067320625%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000156646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=winter-hats&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m135&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42419 pages (at 49 pages/min), scraped 948 items (at 2 items/min)
2026-01-04 13:44:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m15&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hoist-rings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1526A71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221526A71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~m135/
2026-01-04 13:44:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/for-screw-size~m36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-aluminum-oxide-sanding-rolls&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:25 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~m15/
2026-01-04 13:44:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/felt-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hold-down-toggle-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/for-screw-size~m36/
2026-01-04 13:44:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-545/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/military-specification~ms15795-514/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chain/chain-grade~30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ceramic-terminal-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-bn832h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~18-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/material~wool-felt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hold-down-toggle-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-brass-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-545&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:44:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/material~wool-felt/
2026-01-04 13:45:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/grade-30-chain-not-for-lifting&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~ms15795-514&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-bn832h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~18mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/specifications-met~ms15795-545/
2026-01-04 13:45:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/grade-30-chain-not-for-lifting/
2026-01-04 13:45:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/hole-diameter~3-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42461 pages (at 42 pages/min), scraped 949 items (at 1 items/min)
2026-01-04 13:45:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/washers/specifications-met~ms15795-514/
2026-01-04 13:45:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119576%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hole-punches/for-hole-diameter~18mm/
2026-01-04 13:45:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/washers/specifications-met~nas1149-d0816h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/roller-chain-trade-number~180&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/16-chain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=square-duct-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119576%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-bn832h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:45:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hole-punches/for-use-on~composite-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8304400284430&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8304400284430%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002219836%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=book-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-hole-diameter~3-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hollow-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0816h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hole-punches/for-hole-diameter~3-1-8/
2026-01-04 13:45:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain/trade-size~16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hole-punches/for-use-on~composites&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-and-belt-pulleys/shaft-diameter~10-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hook-and-loop-cinching-straps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chain/trade-size~16/
2026-01-04 13:45:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-and-belt-torque-limiters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:51 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hole-punches/for-use-on~composites/
2026-01-04 13:45:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6843160484390&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20and%20belt%20pulleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6843160484390%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000092968%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8607689574665&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8607689574665%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=washers/specifications-met~nas1149-d0816h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:45:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-breakers/roller-chain-trade-number~50&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=squeegees/performance~metal-detectable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hollow-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:45:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-number~100h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hooks/latch-type~slide-bolt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hook-and-loop-cinching-straps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4740521818155&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20breakers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4740521818155%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000050345%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6521638376512&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=squeegees&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6521638376512%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107282%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2977408974097&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2977408974097%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144982%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boring-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42510 pages (at 49 pages/min), scraped 949 items (at 0 items/min)
2026-01-04 13:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/batteries/manufacturer-equivalent-number~sr67/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3598T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223598T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/color~light-gray/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-links/roller-chain-trade-number~50h-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/color~fluorescent-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hooks/latch-type~slide-bolt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/color~red/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/fitting-connection~flared-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2977408974097&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2977408974097%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=sr67-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6392083707491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6392083707491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/for-use-with~methanol-methyl-alcohol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/color~light-gray&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-air-driven-ball-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/color~neon-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/color~red&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002200122%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2977408974097&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2977408974097%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/color~neon-green/
2026-01-04 13:46:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crayons/marking-material~wax/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~methanol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6803K71&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226803K71%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:46:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/for-use-with~sulfuric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-014/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522000%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/for-use-with~methanol/
2026-01-04 13:47:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-lubricators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2977408974097&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2977408974097%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-vise-grips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42557 pages (at 47 pages/min), scraped 951 items (at 2 items/min)
2026-01-04 13:47:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wax-crayons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-blind-rivet-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-014inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/for-use-with~sulfuric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-wear-gauges/roller-chain-trade-number~12b&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:28 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2977408974097&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20links&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2977408974097%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000134059%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-038/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-048/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-014inches/
2026-01-04 13:47:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2198398498524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2198398498524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965374%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-wear-gauges/roller-chain-trade-number~40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4084108751959&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20wear%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4084108751959%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-208/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wedge-anchors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-clothing-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4084108751959&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20wear%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4084108751959%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chargers/mount-type~freestanding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:45 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4084108751959&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20wear%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4084108751959%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000103335%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-wear-gauges/roller-chain-trade-number~12b&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:47:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-038inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-048inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:52 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4084108751959&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20wear%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4084108751959%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000117439%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-wear-gauges/roller-chain-trade-number~40&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:47:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-215/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wedges/material~beryllium-copper/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9980665759275&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chargers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9980665759275%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010917%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:47:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-038inches/
2026-01-04 13:47:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-208inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wedge-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-048inches/
2026-01-04 13:48:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~7-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/check-valves/for-use-with~methanol-methyl-alcohol/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-208inches/
2026-01-04 13:48:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/weld-on-hasps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42601 pages (at 44 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:48:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-215inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wedges/material~beryllium-copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stainless-steel-finishes-selector-packs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~0-884/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-21875inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-215inches/
2026-01-04 13:48:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2317539866962&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2317539866962%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001510712%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=box-trucks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=check-valves/for-use-with~methanol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemical-resistant-pvc-duct&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=weld-on-hasps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-21875inches/
2026-01-04 13:48:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~0-884inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/check-valves/for-use-with~methanol/
2026-01-04 13:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~1-049/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=boxes-with-lids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~1-259/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemical-resistant-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~0-884inches/
2026-01-04 13:48:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~1-025/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~1-902/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemours-krytox-gpl-225-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chemours-krytox-gpl-227-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:48:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chimney-brush-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~1-049inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~11/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~1-259inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~150-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:09 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~1-049inches/
2026-01-04 13:49:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~1-025inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~1-259inches/
2026-01-04 13:49:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42650 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:49:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/air-cylinder-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~1-902inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~1-025inches/
2026-01-04 13:49:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~11inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~1-902inches/
2026-01-04 13:49:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/welding-shirts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~150millimeters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chisel-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chlorine-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose/id~4-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=christmas-tree-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~11inches/
2026-01-04 13:49:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brackets/linear-motion-air-cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/chuck-adapters/for-use-with~jancy-magnetic-base-drills/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~150millimeters/
2026-01-04 13:49:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989682661706&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brackets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989682661706%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22LEGACYGROUP%22%2C%22values%22%3A%7B%22productSetId%22%3A%22618977536775%22%7D%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=welding-shirts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheel-grinders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose/id~4-75inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chucks/for-manufacturer~dremel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chucks/chuck-and-adapter-for-jancy-magnetic-base-drills&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=braided-steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circle-cotter-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:49:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose/id~4-75inches/
2026-01-04 13:50:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-cuffs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6740743282145&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chucks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6740743282145%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002147818%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/chucks/chuck-and-adapter-for-jancy-magnetic-base-drills/
2026-01-04 13:50:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=circuit-board-capacitors/capacitor-type~metalized-polypropylene-film&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheel-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-expanders/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-grinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~air/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42695 pages (at 45 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:50:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2286612241917&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=circuit%20board%20capacitors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2286612241917%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005337892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~alcohol-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheel-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~neon/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-expanders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass/temper-rating~1-2-hard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass/temper-rating~full-hard&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-cuffs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~alcohol&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2286612241917&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=circuit%20board%20capacitors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2286612241917%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005337892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamp-on-framing-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5551584616364&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brass&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5551584616364%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002295390%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965056%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5551584616364&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=brass&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5551584616364%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002297271%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose-fittings/connection-style~barbed/for-use-with~alcohol/
2026-01-04 13:50:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/for-use-with~sodium-carbonate-soda-ash/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~neon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/wheel-diameter~16-1-8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/gender~male-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2286612241917&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=circuit%20board%20capacitors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2286612241917%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005337892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-fittings/fitting-connection~barbed-2/material~zinc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:50:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/wheel-diameter~3-29-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/wheel-diameter~4-59-64/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clamp-on-framing-rail-supports&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/for-use-with~sodium-carbonate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42742 pages (at 47 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:51:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~16-1-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose-fittings/connection-style~barbed/for-use-with~sodium-carbonate/
2026-01-04 13:51:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2286612241917&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=circuit%20board%20capacitors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2286612241917%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000005337892%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:51:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~3-29-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wheels/wheel-diameter~5-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/fuse-blocks/fuse-ul-class~h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001928227%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-shut-off-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1479849910224&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1479849910224%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924561%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wide-mouth-plastic-bottles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=class-z-gauge-pins&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:36 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001924561%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~3-29-32&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:51:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wheels/wheel-diameter~5-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hot-gloves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=class-h-fuse-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-shut-off-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hub-locking-bushings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wide-mouth-plastic-bottles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9899648339233&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9899648339233%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001921343%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/winches/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clean-room-ladders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2308T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222308T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hose-to-pipe-couplings/material~brass-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hot-gloves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:51:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hub-locking-bushings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/window-air-conditioners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clean-room-pens&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=winches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42787 pages (at 45 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:52:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2308T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222308T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-hose-to-pipe-couplings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-flanges/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=window-air-conditioners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-pump-valves/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-tubing-benders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2308T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222308T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-with~formaldehyde&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/hydraulic-reservoirs/for-use-with~oil/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=standard-tap-and-die-wrench-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaning-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-pump-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968108%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clear-domes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2308T41&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222308T41%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:52:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9998225260164&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cleaners&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9998225260164%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002968108%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cleaners/for-use-with~formaldehyde&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:52:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrenches/square-drive-size~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clear-rulers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hydraulic-reservoirs/for-use-with~oil&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/cable-awg~20-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:52:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/in-line-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7305746640836&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7305746640836%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967526%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clearflex-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrenches/square-drive-size~1-5inches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clipper-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=brass-threaded-pipe-to-hose-fittings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clips/material~elastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42838 pages (at 51 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:53:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/cable-awg~20-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:13 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wrenches/square-drive-size~1-5inches/
2026-01-04 13:53:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9975836744491&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clips&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9975836744491%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001511853%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indexable-boring-bars/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=in-line-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indicator-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indicators/for-use-with~carbon-dioxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/indicators/for-use-with~hydraulic-fluid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001562950%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~0-059/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=breadboards&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~0-065/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indexable-boring-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicator-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~carbon-dioxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=indicators/for-use-with~hydraulic-fluid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-059&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/industrial-grade-receptacles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/industrial-laminate/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-065&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:53:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001554950%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cls-256-2-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540398%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/clutches/shaft-diameter~1-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42883 pages (at 45 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:54:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=industrial-grade-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=industrial-laminate&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:15 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001540398%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-065&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 13:54:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=hose-fittings/connection-style~barbed/gender~male&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/trammels/manufacturer~starrett-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~0-127/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clutches/shaft-diameter~1-3-4-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:25 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8082K15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228082K15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:54:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/hose-fittings/connection-style~barbed/gender~male/
2026-01-04 13:54:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insert-bearings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=clutches/shaft-diameter~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/clutches/shaft-diameter~1-3-4-1/
2026-01-04 13:54:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~0-2031/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=starrett-trammels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8003134391132&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=clutches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8003134391132%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000140902%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-127&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:43 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9979599325048&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9979599325048%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964834%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:54:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~1-1-16-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-monitors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insert-bearings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-reels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524957%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~1-1-8-18/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~0-2031&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:54:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001547088%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~2-85-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~3-16-100-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-size~1-5/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~1-1-16-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=static-control-vacuums&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coffee-maker-cleaner&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~1-1-8-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A124&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A124%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42932 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:55:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000079034%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002451177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~2-85-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~3-16-100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-size~1-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~4-55-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A124&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A124%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536086%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:33 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/inserts/thread-size~3-16-100/
2026-01-04 13:55:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/diameter~4-85-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coil-spring-round-belts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/flexibility~extra-flexible/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~4-55mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A124&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A124%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collapsible-bollard-posts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inserts/thread-type~uns/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/diameter~4-85mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:55:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/diameter~4-55mm/
2026-01-04 13:56:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/flexibility~extra-flexible&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:00 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8890K148&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228890K148%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:56:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/diameter~4-85mm/
2026-01-04 13:56:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/inspection-tags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3009A124&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223009A124%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:56:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 42980 pages (at 48 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:56:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/outer-jacket-color~pink/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulating-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/backing-type~plain/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inserts/thread-type~uns&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collet-adapters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107915%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=inspection-tags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/outer-insulation-color~pink&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9893535896715&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9893535896715%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454032%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:56:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulating-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/backing-type~plain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/outer-insulation-color~pink/
2026-01-04 13:56:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2900A253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222900A253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:56:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/for-use-on~aluminum-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/for-use-on~guide-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001529519%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire/mcm-wire-size~250-mcm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=collets/collet-size~27-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/duct-hose/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/for-use-on~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/silicone-sealants/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3966958597415&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=collets&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3966958597415%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003446589%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:56:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~aluminum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~guide-rails&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire/wire-gauge~250-mcm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-cages/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:07 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1322029403092&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1322029403092%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000075638%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:57:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-duct-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/for-use-on~vinyl-plastic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43028 pages (at 48 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:57:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/insulation/for-use-on~aluminum/
2026-01-04 13:57:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:15 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire/wire-gauge~250-mcm/
2026-01-04 13:57:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/material~copper-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/insulation/for-use-on~steel/
2026-01-04 13:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930267%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/insulation/performance~interference-shielding/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7545A451&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227545A451%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-filled-epoxies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-flexible-drive-shafts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/material~copper&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-connectors/number-of-poles~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/shape~triangle&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/insulation/material~copper/
2026-01-04 13:57:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=insulation/performance-properties~interference-shielding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002308796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7545A451&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227545A451%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-connectors/number-of-poles~2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:57:57 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/insulation/performance-properties~interference-shielding/
2026-01-04 13:57:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-connectors/terminal-material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/number-of-poles~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=color-changing-humidity-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=color-coding-key-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:09 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3257A36&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223257A36%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:58:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1712501638756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1712501638756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001525633%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43076 pages (at 48 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:58:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7545A451&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227545A451%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/number-of-poles~2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9800267239863&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9800267239863%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929845%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:58:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/interval-timers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-connectors/terminal-material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1712501638756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1712501638756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001526969%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-housing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-management-clamps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-audible-alarms-indicator-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/wire-connectors/terminal-material~brass/
2026-01-04 13:58:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7545A451&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227545A451%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:58:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-mop-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9552T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229552T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~3-5-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=interval-timers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/iron-tubing/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-housing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-management-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/roller-chain/chain-standard~iso/roller-chain-trade-number~08b/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~2-1-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~no-34&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9552T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229552T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:58:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/isopropyl-wipes/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/drive-size~3-5-mm-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iron-tubing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~29-mm/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/combination-wrenches/drive-size~55-mm-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3236610467807&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=combination%20wrenches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3236610467807%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003488447%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=iso-08b-roller-chain&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/drive-size~3-5-mm-1/
2026-01-04 13:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~2-1-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43121 pages (at 45 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 13:59:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=isopropyl-wipes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9552T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229552T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~29-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:21 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~2-1-16/
2026-01-04 13:59:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=combination-wrenches/size~55-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jacobs-taper-arbors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buffers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:28 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~29-mm/
2026-01-04 13:59:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-rope-tensioners/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/combination-wrenches/size~55-mm/
2026-01-04 13:59:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=buffing-compounds&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-shelf-carts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9552T93&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229552T93%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 13:59:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tackle-boxes/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~1-3-4-5-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~1-3-8-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jacobs-taper-arbors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-swivel-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-rope-tensioners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-spool-racks/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-shelf-carts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 13:59:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-tackle-boxes&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-3-4-5&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=command-strips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-3-8-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:08 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/jam-nuts/thread-size~1-3-4-5/
2026-01-04 14:00:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-taps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wire-straps/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43166 pages (at 45 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:00:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jam-nuts/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-spool-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=build-your-own-storage-cabinets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:24 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=940728682702&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B940728682702%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334773%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~1-3-8-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:00:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-torsion-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-tote-baskets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wire-taps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulk-storage-crates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jam-nuts/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cleaners/for-use-on~wood-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=steel-weld-neck-flanges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/jam-nuts/thread-size~5-16-24/
2026-01-04 14:00:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compressed-air-enclosure-coolers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-files/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jars/capacity~20-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bulkhead-valves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-screws/drive-style~hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-butt-splices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:00:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jaw-clips/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-cleaners&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=compression-shear-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-screws/screw-size~no-24/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jars/capacity-weight-~20-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43214 pages (at 48 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:01:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/drive-style~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/jis-8303-power-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=computer-power-cables&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:18 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/jars/capacity-weight-~20-ml/
2026-01-04 14:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wood-sheets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jaw-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000069575%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/joints/fitting-type~locknut/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wool-felt/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-screws/screw-size~no-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumper-railings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=jis-8303-power-cords&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/work-chairs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2724637663046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2724637663046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002449460%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/work-lights/mount-type~hook/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wood-sheets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=joints/type~locknut&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/junction-boxes/cover-material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wool-felt&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/work-lights/mounting-location~stake/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:52 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/joints/type~locknut/
2026-01-04 14:01:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-chairs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/workbench-legs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:01:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=work-lights/mount-type~hook&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stick-electrodes/aws-material-code~e312&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bumpers/thread-size~m8-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=junction-boxes/cover-material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1685134723634&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1685134723634%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010858%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9938597167718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=stick%20electrodes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9938597167718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002321096%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/fitting-type~grommet&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43260 pages (at 46 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:02:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit/thread-size~5-8-11-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:14 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/junction-boxes/cover-material~steel/
2026-01-04 14:02:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=workbench-legs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2346N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222346N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~0045/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrap-around-pipe-labels/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conduit&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002465903%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bumpers/thread-size~m8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conduit&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002333424%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wraparound-brackets/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:31 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bumpers/thread-size~m8/
2026-01-04 14:02:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wrench-handles/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conduit-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2346N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222346N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrap-around-pipe-labels&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0045&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conduit&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002465903%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~0900/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wraparound-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=confidential-document-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wrench-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stop-nuts/material~brass-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:02:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2346N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222346N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conduit&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002465903%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~103am/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~0900&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43307 pages (at 47 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:03:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~12g048/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400520%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stop-nuts/material~brass&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2346N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222346N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conformable-foam&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:19 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5860541886895&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conduit&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5860541886895%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002465903%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:03:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushing-blocks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~103am&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:24 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/stop-nuts/material~brass/
2026-01-04 14:03:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~12g100/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~2081/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~103am/
2026-01-04 14:03:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~22337/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~12g048&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~2440/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401346%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~12g100&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/shape~double-90-elbow&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~2081&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400268%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:03:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/thread-type~bsf&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~22337&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400994%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002313292%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~2440&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:03:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401286%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=storeroom-locksets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stove-handles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394399%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400649%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400246%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5779K253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225779K253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43356 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A323&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A323%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=constant-force-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:13 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9989162792774&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=connectors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9989162792774%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002394399%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=connectors/thread-type~bsf&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~3300/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~3770/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5779K253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225779K253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=constant-pressure-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straight-line-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A323&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A323%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~55773/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~1-2-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3300&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~19-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~3770&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400617%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002125796%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5779K253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225779K253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~55773&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400825%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:54 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122234%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~1-2-ml&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:04:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A323&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A323%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/ws14-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:04:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~25-cu-ft&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401347%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/fitting-connection~flanged&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=5779K253&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%225779K253%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:05:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~neon&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001999108%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43407 pages (at 51 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:05:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=12095A323&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2212095A323%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:05:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=ws14-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965301%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=strainers/for-use-with~nitrogen-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4064T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224064T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/wyes/pipe-size~1-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~3-5-gal/capacity~3-1-2-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~bes2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964512%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~400-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122991%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98355K833&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298355K833%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4064T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224064T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101571%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=wyes/pipe-size~1-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:54 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:05:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~bes2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:05:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9984228142725&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9984228142725%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000074440%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=11775A806&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2211775A806%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:06:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~hr/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:05 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~bes2/
2026-01-04 14:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98355K833&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298355K833%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~in8/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4064T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224064T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity~85-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43456 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:06:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~10-cu-ft/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~60-qt/capacity~15-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:17 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9758266108659&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=strainers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9758266108659%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002362375%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:06:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9958071509783&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=containers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9958071509783%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148366%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~hr&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~mc16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98355K833&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298355K833%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~150-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~in8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:27 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=4064T14&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%224064T14%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:06:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~10-cu-ft-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:30 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~hr/
2026-01-04 14:06:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~15-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:36 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~in8/
2026-01-04 14:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~mc4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:39 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~10-cu-ft-/
2026-01-04 14:06:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~mc29/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/containers/capacity~1975-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~15-gal-/
2026-01-04 14:06:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98355K833&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298355K833%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:06:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number~mc62/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~150-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/bushings/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zinc-plated-steel-washers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:56 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~150-ml/
2026-01-04 14:06:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:06:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400896%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc29&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=containers/capacity-weight-~1975-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/sling-type~drum&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~mc62&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-bags/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002400250%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401104%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=bushings/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/containers/capacity-weight-~1975-ml/
2026-01-04 14:07:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43499 pages (at 43 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:07:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9733419879211&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=straps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9733419879211%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621896%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zinc-plated-steel-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002401093%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/bushings/thread-size~5-16-24/
2026-01-04 14:07:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/stretch-wrap/film-gauge~63/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9733419879211&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=straps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9733419879211%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001621896%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=straps/sling-type~drum&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:07:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~15-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/key-number-equivalent~wr3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/overall-length~2-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-bags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~2-11-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/overall-length~2-5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~78/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stretch-wrap/film-gauge~63-ga&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~15-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=contoured-backup-rings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/key-number~wr3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/zip-ties/length~6-3-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~2-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~2-11-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:49 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/stretch-wrap/film-gauge~63-ga/
2026-01-04 14:07:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~2-5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001608186%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/keys/key-number~wr3/
2026-01-04 14:07:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001617467%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:07:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/keys/width~1-1-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001626634%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001584650%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:01 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001608186%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~15-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:08:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/conveyor-belt-lacing/hook-type~short-point-sp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~6-3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:06 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001617467%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~2-1-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:08:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:10 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001584650%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=zip-ties/length~2-5-16&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:08:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43545 pages (at 46 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:08:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knives/blade-type~razor/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-covers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9722797833693&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9722797833693%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001619945%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-brushes/bristle-material~brass-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~1-1-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knives/for-use-on~nickel-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-belt-lacing/hook-style~short-point-sp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=7377080483436&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20brushes&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B7377080483436%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000077533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-doors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-gates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/blade-type~razor&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/conveyor-belt-lacing/hook-style~short-point-sp/
2026-01-04 14:08:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/material~zinc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/mount-type~clamp-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:36 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260934905351&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260934905351%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000144134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=keys/width~1-1-2&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:08:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knives/for-use-on~nickel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2846472700070&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2846472700070%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003034284%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knobs/mount-type~strap-on/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/knurled-component-knobs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:48 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/knives/for-use-on~nickel/
2026-01-04 14:08:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3954A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223954A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/material~zinc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/mount-type~clamp-on&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=conveyor-rollers/roller-diameter~3&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512333%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:08:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=stubby-nutdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knobs/mount-type~strap&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010808%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=knurled-component-knobs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1360744530601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=conveyor%20rollers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1360744530601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000162560%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolant-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3954A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223954A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8323758595347&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8323758595347%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003010750%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43596 pages (at 51 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7535N57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227535N57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lamp-accessories/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3954A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223954A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coolants/for-machining-type~honing&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cabinet-fans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:31 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=98295T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2298295T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=coping-saws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7535N57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227535N57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=super-white-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5998243833923&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=coolants&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5998243833923%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002084091%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copper-nickel-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lamp-accessories&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3954A11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223954A11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:09:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lathes/cut-type~grind-your-own/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=copy-seals&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~002714-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cord-grips/thread-size~m6-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~006482-40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7535N57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227535N57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:09:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~1224/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathes/cut-type~grind-your-own&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-plates/material~granite&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/coaxial-cords/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=surface-thermocouples&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43645 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:10:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~002714-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cord-grips/thread-size~m6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~006482-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:15 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7535N57&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227535N57%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2919599794209&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2919599794209%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002233008%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8497304929127&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=surface%20plates&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8497304929127%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001512665%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~1224&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122675%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cord-grips/thread-size~m6/
2026-01-04 14:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:26 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2919599794209&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2919599794209%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002233008%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lathes/cut-type~grind-your-own&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:10:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/connection-type~coaxial&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:31 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002122675%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~002714-40&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:10:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~g-453-el/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/electrical-connection~turn-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:35 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083806%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~006482-40&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:10:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:37 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cords/connection-type~coaxial/
2026-01-04 14:10:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002078621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~1224&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:10:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swing-clamps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-c30/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003411373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-eca-het-rk/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switch-lockout-cover-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cords/voltage~60v-ac&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/switches/actuator-style~rocker-switch-with-slide-dimmer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~g-453-el&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/actuator-style~fusible-link&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9957431150989&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cords&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9957431150989%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553715%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-m1-cp/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:10:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119623%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-c30&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001936548%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6000-mk/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-het-rk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/actuator-style~rocker-with-slide-dimmer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:09 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002119623%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~g-453-el&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7306N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227306N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43696 pages (at 51 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:11:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133404%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lavatory-equipment/manufacturer-model-number~p6003-h/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/switches/actuator-style~rocker-with-slide-dimmer/
2026-01-04 14:11:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-m1-cp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:20 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002107415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-c30&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:11:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-mk&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:23 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002133404%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-eca-het-rk&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:11:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148133%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7306N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227306N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6003-h&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/enclosure-rating~nema-2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:38 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002148133%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-m1-cp&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:11:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:43 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002112029%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6000-mk&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:11:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/shielding~unshielded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lcn-4040xp-door-closers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000104134%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7306N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227306N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:52 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=70355K101&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2270355K101%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:11:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001577921%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:55 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1731192636428&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1731192636428%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002106971%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lavatory-equipment/manufacturer-model-number~p6003-h&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:11:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:11:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7480K21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227480K21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counterbore-pilots&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leaf-springs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable/wire-construction~stranded&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/counters/measurement-unit~kilometers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:05 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7452N12&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227452N12%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:12:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lcn-4040xp-door-closers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:11 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7306N1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227306N1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:12:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43746 pages (at 50 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:12:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/countersinks/screw-size~m3/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7480K21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227480K21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=leaf-springs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=counters/measurement-scale~kilometers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/countersink-angle~110&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/outlet-box-designation~2-gang&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/panel-cutout-diameter~16-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5519429302621&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=counters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5519429302621%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003542841%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=983458193638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=countersinks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B983458193638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003441812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/for-screw-size~3-mm&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/panel-cutout-diameter~3-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7480K21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227480K21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002215461%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:44 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=983458193638&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=countersinks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B983458193638%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003441812%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersinks/countersink-angle~110&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:12:45 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/countersinks/for-screw-size~3-mm/
2026-01-04 14:12:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002214466%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=countersunk-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6886K111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226886K111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leds/bulb-shape-number~t3-1-4/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3980T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223980T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:12:56 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=7480K21&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%227480K21%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:12:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-carriers-for-telescoping-robot-bases&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switch-designation~3pst-2no-1nc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/leds/bulb-shape-number~t6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/couplings/shaft-type~hex/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6886K111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226886K111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43797 pages (at 51 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:13:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=LEDs/bulb-shape-number~t3-1-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9776671492613&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cable&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9776671492613%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003931378%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:13:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015553%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3980T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223980T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/left-hand-threaded-screws/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948839639468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948839639468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000114490%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6299T15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226299T15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=LEDs/bulb-shape-number~t6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-shaft-type~hex&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switch-type~remote-reading&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9948839639468&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9948839639468%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002068001%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3980T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223980T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/couplings/for-shaft-type~hex/
2026-01-04 14:13:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6886K111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226886K111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:42 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003015188%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:13:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=left-hand-threaded-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002244540%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6299T15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226299T15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8607K6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228607K6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~ethylene-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/mount-type~stud-anchor/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47525K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247525K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:13:58 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3980T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223980T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:13:59 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6886K111&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226886K111%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:14:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967577%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6299T15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226299T15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~1-1-4-12/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8607K6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228607K6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43846 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:14:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A666&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A666%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~hydrogen-chloride&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/mount-type~anchor&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47525K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247525K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965162%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:26 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6299T15&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226299T15%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:14:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8607K6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228607K6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/for-use-with~perfluoropropane&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A666&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A666%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-grommets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47525K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247525K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964621%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~1-14/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:45 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=6570T1&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%226570T1%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:14:46 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334373%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-1-4-12&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:14:47 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=8607K6&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%228607K6%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:14:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A666&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A666%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~10-32/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A326&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A326%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:53 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=47525K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2247525K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:14:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/levels/thread-size~3-8-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:14:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~1-14&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=couplings/thread-size~1-1-4-7&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~6-6-amp&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:08 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A666&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A666%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:15:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~10-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A326&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A326%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43898 pages (at 52 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:15:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334356%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-rollers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9981342947220&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=couplings&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9981342947220%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334684%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615113%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=levels/thread-size~3-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lid-props/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000139805%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:27 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9241362370870&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=switches&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9241362370870%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001615113%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=switches/switching-current~6-6-amp&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=4945834745524&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B4945834745524%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-beam-sensors/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A326&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A326%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:33 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A716&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A716%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:15:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulb-grease/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lid-props&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tie-mounts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cpvc-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cr2450n-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-beam-sensors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:49 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=79215A326&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2279215A326%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:15:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-base-type~twist-and-lock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulb-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:15:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=craft-knives&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape~triple-u-shaped/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/base-type~twist-and-lock&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-shape-number~g16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crate-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43948 pages (at 50 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:16:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crate-clips&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crevice-tools&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimp-pipe-caps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/base-type~twist-and-lock/
2026-01-04 14:16:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimpers/for-use-with~bonded-polyester-strapping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/bulb-shape~triple-u-shaped&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crimpers/for-use-with~water-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000025977%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1073/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002964992%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1155/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cross-braces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=swivels/thread-size~2-8&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1528K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221528K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowd-control-lights&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowd-control-stanchions&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9995889107271&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=swivels&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9995889107271%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452177%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1073&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~1533/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1155&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/crowfeet/drive-size~5-16/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1528K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221528K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:16:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1073/
2026-01-04 14:17:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1155/
2026-01-04 14:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/syringes/capacity~20-microl/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 43997 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~1533&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cable-tracks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=crowfeet/size~5-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=culvert-pipe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1528K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221528K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cup-lids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~1533/
2026-01-04 14:17:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cups/cup-shape~v&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringes/capacity-weight-~20-microl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:26 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/crowfeet/size~5-16/
2026-01-04 14:17:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/syringes/capacity~80-ml/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:32 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8050600728590&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=crimpers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8050600728590%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965401%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:17:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/faucet-cartridges/for-manufacturer~t-s-brass/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9963305174922&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cups&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9963305174922%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001632152%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:34 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/syringes/capacity-weight-~20-microl/
2026-01-04 14:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:37 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1528K61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221528K61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:17:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-anchors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=current-loop-calibrators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=syringes/capacity-weight-~80-ml&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=calibration-gas-devices&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~3423g/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-%26-s-brass-faucet-cartridges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=curved-tooth-files&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:17:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=custom-shims&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/syringes/capacity-weight-~80-ml/
2026-01-04 14:18:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/t-handles/sold-as~set/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~386/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44046 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:18:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caliper-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~46/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~3423g&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~48c2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutler-hammer-circuit-breakers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:22 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~3423g/
2026-01-04 14:18:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/individual-set~set&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-handles/thread-size~3-8-16&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~386&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-cutting~din-rails/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=t-molding&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~46&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~48c2&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:35 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/t-handles/individual-set~set/
2026-01-04 14:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9944536682256&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=t%20handles&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9944536682256%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334816%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~755/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:38 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~386/
2026-01-04 14:18:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~46/
2026-01-04 14:18:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~48c2/
2026-01-04 14:18:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cutters/for-use-on~rebar/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-cutting~rigid-conduit&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~912f/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-cutting~din-rail&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~98/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~755&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cv-plugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:18:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/cutters/for-cutting~din-rail/
2026-01-04 14:19:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002929922%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-pivot-brackets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cylinder-wrenches&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cutters/for-use-on~reinforced-concrete&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~755/
2026-01-04 14:19:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~c5w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~912f&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2670A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222670A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44095 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~98&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9988271414601&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=cutters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9988271414601%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930299%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:16 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~912f/
2026-01-04 14:19:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~e211-2g/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~fb40/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:20 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~98/
2026-01-04 14:19:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dampers/material~leather-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~c5w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~fhe/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2670A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222670A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:32 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~c5w/
2026-01-04 14:19:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~e211-2g&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/bulb-trade-number~h3-25w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~fb40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dampers/material~leather&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dc-motors/motor-type~brushed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:43 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~e211-2g/
2026-01-04 14:19:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~fhe&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~fb40/
2026-01-04 14:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cams&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2670A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222670A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/dampers/material~leather/
2026-01-04 14:19:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9884332045743&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dc%20motors&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9884332045743%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001974051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=deep-well-pumps&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:19:55 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~fhe/
2026-01-04 14:19:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/trade-number~h3-25w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/voltage~1-2v-dc/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dehumidifiers/certification~c-ul-listed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:07 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/trade-number~h3-25w/
2026-01-04 14:20:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=delrin-acetal-resin-rods&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44141 pages (at 46 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cans&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:13 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=2670A3&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%222670A3%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:20:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5150657660087&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dehumidifiers&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5150657660087%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002254507%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-gauges/manufacturer-model-number~445bz-9rl&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=depth-stop-drill-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tabs/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=desiccant-absorbents&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/voltage~1-2v-dc&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8692897390024&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=depth%20gauges&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8692897390024%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002114014%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/cam-locks-cap/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~10/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tabs/material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~17-15-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1024807243217&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1024807243217%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003553646%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/caps/pipe-size~6/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9997023127579&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tabs&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9997023127579%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000147754%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~19-5-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tabs/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K581&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K581%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/connection-style~cam-and-groove&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=caps/for-pipe-size~10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:53 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tabs/material~steel/
2026-01-04 14:20:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~17-15w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~19w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:20:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/caps/connection-style~cam-and-groove/
2026-01-04 14:20:59 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/caps/for-pipe-size~10/
2026-01-04 14:21:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~19-5w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~17-15w/
2026-01-04 14:21:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K581&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K581%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~19w/
2026-01-04 14:21:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~3-23-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tag-ties&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~19-5w/
2026-01-04 14:21:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44190 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:21:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tail-piece-washers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~3-5-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dewars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diagonal-braces&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K581&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K581%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-resistant-hex-insert-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~3-23w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-resistant-receptacles&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~3-5w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~5-5-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/light-bulbs/wattage~55-w/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:40 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~3-23w/
2026-01-04 14:21:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~196a1z&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:42 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~3-5w/
2026-01-04 14:21:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tamper-resistant-torx-plus-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:44 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=1505K581&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%221505K581%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:21:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/8-watt-light-bulbs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082215%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~5-5w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~55w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~513-404-10t&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:21:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/manufacturer-model-number~711lcsz&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/linear-motion-nuts/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tank-measuring-tape&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:03 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~5-5w/
2026-01-04 14:22:04 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~55w/
2026-01-04 14:22:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002113013%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=light-bulbs/wattage~8w&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dial-indicators/mount-type~shank&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002100494%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44240 pages (at 50 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:22:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:17 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/light-bulbs/wattage~8w/
2026-01-04 14:22:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9260072862737&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dial%20indicators&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9260072862737%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003011039%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~100-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=linear-motion-nuts&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diaper-rags&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=diamond-grinding-bits&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002101160%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liquid-filters/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~300-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-cast-zinc-sheaves&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity~7-1-gal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082415%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/liquid-rubber/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-filters&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-grinders/speed-control-type~fixed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-grinders/speed-control-type~variable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=cardboard-cartons&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~18-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:22:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=die-setters-bars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8549892642718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=die%20grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8549892642718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003030835%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lithium-ion-(li-ion)-batteries/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8549892642718&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=die%20grinders&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8549892642718%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000003031006%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=liquid-rubber&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locating-pads/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44289 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:23:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~4-7-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~18-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lithium-ion-(li-ion)-batteries&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tanks/capacity~26-qt/capacity~6-5-gal/capacity~6-1-2-gal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lock-downs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~18-gal-/
2026-01-04 14:23:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/carriage-and-plow-bolts/material~steel-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locating-pads&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~1-18&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~4-7-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locking-pliers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tanks/capacity-weight-~6-1-2-gal-&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:41 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~4-7-gal-/
2026-01-04 14:23:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lock-downs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=carriage-and-plow-bolts/material~steel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:46 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9994038592548&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tanks&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9994038592548%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002082035%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locks/for-use-on~metal/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~12-36&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:50 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tanks/capacity-weight-~6-1-2-gal-/
2026-01-04 14:23:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locking-pliers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:54 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/carriage-and-plow-bolts/material~steel/
2026-01-04 14:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:23:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/locks/opens-with~square-key/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~2-933-12-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~3-8-10&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/for-use-on~metal&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44337 pages (at 48 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:24:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453115%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dies/thread-size~5-40&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002454521%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=locks/opens-with~square-key&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-4031/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001969068%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tap-magic-protap-cutting-fluids&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:33 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-4204/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/for-surface-type~bar-grating&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-4031&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:41 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002452980%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:24:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=casters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001968458%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-4210&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-4601/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-4204&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=casters/frame-material~iron-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:24:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-592/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-gun-blades&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/position-indicators/display-type~digital/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=1981438481801&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=casters&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B1981438481801%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001536297%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44386 pages (at 49 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:25:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-4601&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:16 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9971224262213&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9971224262213%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002930009%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:25:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9936T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229936T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-592&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dimple-dies&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:23 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9850566353046&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dies&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9850566353046%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002334642%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:25:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=digital-position-indicators&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-479-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-915-set-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-super-glue/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loctite-us2651/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9936T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229936T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=din-931-cap-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:40 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~33-425&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/loops/material~iron-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~l1225alcme&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-super-glue&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083216%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~l1235&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loctite-us2651&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9936T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229936T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~w928&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:25:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004908118%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:00 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002083216%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~33-425&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:26:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004908065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=loops/material~iron&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-racks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004903846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:07 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004908118%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~l1225alcme&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:26:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/low-temperature-coatings/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:11 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004908065%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~l1235&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:26:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44438 pages (at 52 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:26:12 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/loops/material~iron/
2026-01-04 14:26:13 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/low-voltage-cable/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:14 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9936T61&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229936T61%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:26:16 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=5504631511088&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=tape%20measures&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B5504631511088%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000004903846%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tape-measures/manufacturer-model-number~w928&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:26:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=disc-calendars&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:22 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/additive~deoxidizer/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/for-machining-type~tapping/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/manufacturer~marvel/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:27 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-temperature-coatings&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tapits-screws&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=low-voltage-cable&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tapping-head-collets&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/component~die&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dispensing-pumps/for-use-with~paint&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/additive~deoxidizer&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/for-machining-type~tapping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/manufacturer~marvel&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:48 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002259894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=94368702282&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dispensing%20pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B94368702282%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965550%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubricants/manufacturer~trico/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001537794%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lubrication-hose/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002139105%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002260369%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:26:58 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=94368702282&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dispensing%20pumps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B94368702282%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965550%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dispensing-pumps/for-use-with~paint&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:27:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/pipe-size~3-4&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9050T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229050T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=center-finder-gauges&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubricants/manufacturer~trico&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000000009285%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44488 pages (at 50 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:27:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lubrication-hose&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lufkin-tape-measures/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:17 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dock-door-track-protectors&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-1-8-8-1&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8998767593156&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8998767593156%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002251132%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/lugs/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9050T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229050T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-2-32&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002455154%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/taps/thread-size~1-3-8-6-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machinable-ceramic/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3987871406277&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=taps&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3987871406277%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002453742%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lufkin-tape-measures&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-key-bar-stock/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:41 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/machine-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=lugs&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9050T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229050T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=taps/thread-size~1-3-8-6&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machinable-ceramic&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnet-stands/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:27:59 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=machine-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-lock-cylinders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:00 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/taps/thread-size~1-3-8-6/
2026-01-04 14:28:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:03 [scrapy.downloadermiddlewares.retry] (PID: 126) ERROR: Gave up retrying <GET https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=9050T13&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%229050T13%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true> (failed 3 times): 403 response
2026-01-04 14:28:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-lock-plates&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnetic-nutdrivers/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44533 pages (at 45 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:28:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=door-plungers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/magnets/material~iron-oxide/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:15 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnet-stands&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/battery-chargers/manufacturer~makita-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/fitting-connection~barbed-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=double-door-weatherstripping&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:24 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/fitting-connection~compression-1/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:30 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnetic-nutdrivers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=magnets/material~iron-oxide&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:35 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:36 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=makita-battery-chargers&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/connection-style~barbed&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-9-1363-adhesives-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:42 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/dupont-molykote/trade-name~molykote-z-powder/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-995-adhesives-sealants&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:44 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=3815738403502&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B3815738403502%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528491%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-molykote-g-4501fm-grease&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:46 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/manifolds/connection-style~barbed/
2026-01-04 14:28:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/connection-style~compression&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/for-use-with~compressed-air/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/for-use-with~nitric-acid/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/manifolds/for-use-with~water-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:28:58 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/manifolds/connection-style~compression/
2026-01-04 14:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/respirator-masks/niosh-approval-number~tc-84a-2561/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dow-corning-molykote-z-powders&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:02 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:07 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:08 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/for-use-with~compressed-air&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/for-use-with~nitric-acid&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44580 pages (at 47 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:29:12 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-033&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:14 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=manifolds/for-use-with~water&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-046&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:16 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/markers/color~fluorescent-green/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tc-84a-2561-respirator-masks&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:18 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=chain-and-belt-pulleys/belt-trade-size~a&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:19 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002967611%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:20 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-074&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:21 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8489049994451&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8489049994451%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002965017%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:23 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:23 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/manifolds/for-use-with~water/
2026-01-04 14:29:25 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522089%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:26 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:28 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=6843160484390&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=chain%20and%20belt%20pulleys&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B6843160484390%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001991699%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:29 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=61975K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2261975K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:31 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:32 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3942N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223942N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:32 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522764%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-033&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:29:34 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:34 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001522089%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-046&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:29:37 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/products/tee-nuts/thread-size~5-16-24-2/ already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:38 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=markers/color~fluorescent-green&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:39 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:40 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001524051%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-074&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:29:43 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:45 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-092&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:46 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:47 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:49 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:50 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3942N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223942N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:51 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:52 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001537533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:53 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:54 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1251&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:55 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-131&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:56 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:57 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tee-nuts/thread-size~5-16-24&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:29:58 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=masking-tape/color~gold&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:00 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/tokenauthorization.aspx already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1565&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:01 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001537533%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-092&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:30:01 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=61975K56&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%2261975K56%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:03 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=tees/for-use-with~dairy&srchtxt=&mixedworld=force&workstationdata=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:04 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001528151%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:05 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001516950%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:06 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=9853367128756&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B9853367128756%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000002196894%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:06 [mcmaster_carr] (PID: 126) WARNING: no value.entitites: https://www.mcmaster.com/products/tee-nuts/thread-size~5-16-24/
2026-01-04 14:30:09 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=2584190231621&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B2584190231621%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001549824%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:10 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/WebParts/Content/ItmPrsnttnWebPart.aspx?partnbrtxt=3942N11&componentpartnbrtxt=&possiblecompnbrtxt=&attrcompitmids=&attrnm=&attrval=&cntnridtxt=MainContent&proddtllnkclickedInd=true&printprsnttnInd=false&screenDensity=1&cssAlias=undefined&clientNavigationEvents=%5B%7B%22type%22:%22ORDERINGMASTERPARTNUMBER%22,%22selectionType%22:%22SELECTION%22,%22values%22:%7B%22entities%22:%223942N11%22,%22preselectedComponentPartNumber%22:%22%22%7D%7D%5D&mixedworld=force&workstationdata=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&AttrRelRefinedSort=true&envrmgrcharsetind=3&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:11 [HeadersSpooferDownloaderMiddleware] (PID: 126) WARNING: Request https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001537530%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true already has headers. They will be preserved, but that may lead to fingerprint inconsistency. If the headers are necessary, consider disabling SPOOF_FULL_HEADERS.
2026-01-04 14:30:12 [scrapy.extensions.closespider] (PID: 126) INFO: Closing spider since no items were produced in the last 1800 seconds.
2026-01-04 14:30:12 [scrapy.core.engine] (PID: 126) INFO: Closing spider (closespider_timeout_no_item)
2026-01-04 14:30:12 [scrapy.extensions.logstats] (PID: 126) INFO: Crawled 44632 pages (at 52 pages/min), scraped 951 items (at 0 items/min)
2026-01-04 14:30:22 [scrapy.core.scraper] (PID: 126) ERROR: Spider error processing <GET https://www.mcmaster.com/mv1767128648/webparts/content/ProdPageWebPart.aspx?cntnridtxt=MainContent&srchidtxt=8905842209266&cntnrwdth=1850&viewporthgt=309&srchrsltdisplovrdind=false&specsrchhexnutsovrdind=false&landingpagesuppressedind=false&srchrslttxt=dowel%20pins&fromprodpagewebpart=true&expandedprsnttns=&cssAlias=undefined&clientNavigationEvents=%5B%7B%22values%22%3A%7B%22searchTerms%22%3A%5B8905842209266%5D%7D%2C%22selectionType%22%3A%22SEARCH%22%2C%22type%22%3A%22SEARCHTERM%22%7D%2C%7B%22values%22%3A%7B%22entities%22%3A%5B%2210000001537530%22%5D%7D%2C%22selectionType%22%3A%22SELECTION%22%2C%22type%22%3A%22SPEC%22%7D%5D&ConstructBLPInTileComponents=true&UseNPPImagesHealthCheck=true&UseNPPCopyHealthCheck=true&mixedworld=force&workstationdata=true&ShowPriceBreakSplits=true&usepackquantitypivoting=true&useSpecSearchConversionLogicToggle=true&UseAttrNullsInPubElemSelection=true&CngLineBreaks=true&PDOnlyCNGs=true&UseSellUnitOfMeasureSplits=true&RedesignedRelatedLists=true&EnableItemToProductFamilyProjection=true&ApplyAttrRelRefinements=true&TableRefinementsHorizontalAlignment=true&AttrRelRefinedSort=true&TableRefinementsSpannerAlignmentAndPositioning=true&TableRefinementsTableColumnAlignment=true&LayoutBoxSszs=true&UsePubElementSelectionCache=true&NavigateSearchTermToClickCountsOptimization=true&EnableClientRenderedSpecSearchProxy=true&CheckBLPContentWebPartViewportRemoval=true&useEs6=true> (referer: https://www.mcmaster.com/mv1767128648/WebParts/RemoteSesnWebPart/SesnAPI.aspx?acttxt=parsehref&href=dowel-pins/diameter~0-1565&srchtxt=&mixedworld=force&workstationdata=true)
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/defer.py", line 327, in iter_errback
    yield next(it)
          ^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/utils/python.py", line 368, in __next__
    return next(self.data)
           ^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/referer.py", line 379, in <genexpr>
    return (self._set_referer(r, response) for r in result)
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/urllength.py", line 57, in <genexpr>
    return (r for r in result if self._filter(r, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/usr/local/lib/python3.11/site-packages/scrapy/spidermiddlewares/depth.py", line 54, in <genexpr>
    return (r for r in result if self._filter(r, response, spider))
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/scrapy/core/spidermw.py", line 106, in process_sync
    yield from iterable
  File "/var/lib/scrapyd/eggs/catalog_extraction/1758126308.egg/catalog_extraction/spiders/mcmaster_carr.py", line 284, in parse_partial_data
    if table_data.get("partNumber") == sku:
       ^^^^^^^^^^^^^^
AttributeError: 'NoneType' object has no attribute 'get'
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ------------------------------ MONITORS ------------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Extracted Items Monitor/test_stat_monitor... OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Item Validation Monitor/test_stat_monitor... SKIPPED (Unable to find 'spidermon/validation/fields/errors' in job stats.)
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Error Count Monitor/test_stat_monitor... FAIL
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Warning Count Monitor/test_stat_monitor... FAIL
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Finish Reason Monitor/Should have the expected finished reason(s)... FAIL
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Unwanted HTTP codes monitor/Should not hit the limit of unwanted http status... OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Field Coverage Monitor/test_check_if_field_coverage_rules_are_met... OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount... FAIL
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Downloader Exceptions monitor/test_stat_monitor... OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Successful Requests monitor/Should have at least the minimum number of successful requests... OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] Total Requests monitor/Should not hit the total limit of requests... OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] 
======================================================================
FAIL: Error Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '1167'

2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] 
======================================================================
FAIL: Warning Count Monitor/test_stat_monitor
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/base.py", line 184, in test_stat_monitor
    assertion_method(
AssertionError: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '40883'

2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] 
======================================================================
FAIL: Finish Reason Monitor/Should have the expected finished reason(s)
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 110, in test_should_finish_with_expected_reason
    self.assertTrue(finished_reason in expected_reasons, msg=msg)
AssertionError: Finished with "closespider_timeout_no_item" the expected reasons are ['finished']

2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] 
======================================================================
FAIL: Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/scrapy/monitors/monitors.py", line 282, in test_maximum_retries
    self.assertLessEqual(max_reached, threshold, msg=msg)
AssertionError: Too many requests (666) reached the maximum retry amount

2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 11 monitors in 0.006s
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] FAILED (failures=4, skipped=1)
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] -------------------------- FINISHED ACTIONS --------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 0 actions in 0.000s
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] --------------------------- PASSED ACTIONS ---------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 0 actions in 0.000s
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] OK
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] --------------------------- FAILED ACTIONS ---------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] CustomTemplateSendSlackMessageSpiderFinished... ERROR
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] ----------------------------------------------------------------------
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) ERROR: [Spidermon] 
======================================================================
ERROR: CustomTemplateSendSlackMessageSpiderFinished
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/twisted/internet/task.py", line 526, in _oneWorkUnit
    result = next(self._iterator)
             ^^^^^^^^^^^^^^^^^^^^
StopIteration

During handling of the above exception, another exception occurred:

Traceback (most recent call last):
  File "/usr/local/lib/python3.11/site-packages/spidermon/core/actions.py", line 39, in run
    self.run_action()
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 252, in run_action
    self.manager.send_message(
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 58, in send_message
    return [
           ^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 59, in <listcomp>
    self.send_message(
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 85, in send_message
    return self._send_channel_message(
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 129, in _send_channel_message
    attachments=self._parse_attachments(attachments),
                ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/site-packages/spidermon/contrib/actions/slack/__init__.py", line 171, in _parse_attachments
    python_attachments = ast.literal_eval(attachments)
                         ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/ast.py", line 64, in literal_eval
    node_or_string = parse(node_or_string.lstrip(" \t"), mode='eval')
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/local/lib/python3.11/ast.py", line 50, in parse
    return compile(source, filename, mode, flags,
           ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "<unknown>", line 4
    "text": "•  _Error Count Monitor/test_stat_monitor_: Expecting 'log_count/ERROR' to be '<=' to '0.0'. Current value: '1167'\n•  _Warning Count Monitor/test_stat_monitor_: Expecting 'log_count/WARNING' to be '<=' to '1000.0'. Current value: '40883'\n•  _Finish Reason Monitor/Should have the expected finished reason(s)_: Finished with "closespider_timeout_no_item" the expected reasons are ['finished']\n•  _Retry Count monitor/Should not hit the limit of requests that reached the maximum retry amount_: Too many requests (666) reached the maximum retry amount\n",
            ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
SyntaxError: invalid syntax. Perhaps you forgot a comma?

2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] 1 action in 0.227s
2026-01-04 14:30:22 [mcmaster_carr] (PID: 126) INFO: [Spidermon] FAILED (errors=1)
2026-01-04 14:30:23 [scrapy.extensions.feedexport] (PID: 126) INFO: Stored bq feed (951 items) in: bq://response-elt.scraper_data.catalog_item_scrape/batch:1
2026-01-04 14:30:23 [scrapy.statscollectors] (PID: 126) INFO: Dumping Scrapy stats:
{'HeadersSpooferDownloaderMiddleware/session/created': 12078,
 'HeadersSpooferDownloaderMiddleware/session/spoofed': 50930,
 'NotFoundHandlerSpiderMiddleware/AttributeError': 1960,
 'NotFoundHandlerSpiderMiddleware/HttpError': 11,
 'big_query/url': 12078,
 'downloader/exception_count': 79,
 'downloader/exception_type_count/scrapy.core.downloader.handlers.http11.TunnelError': 64,
 'downloader/exception_type_count/twisted.internet.error.TimeoutError': 8,
 'downloader/exception_type_count/twisted.web._newclient.ResponseFailed': 3,
 'downloader/exception_type_count/twisted.web._newclient.ResponseNeverReceived': 4,
 'downloader/request_bytes': 60425785,
 'downloader/request_count': 50930,
 'downloader/request_method_count/GET': 36920,
 'downloader/request_method_count/POST': 14010,
 'downloader/response_bytes': 1360649668,
 'downloader/response_count': 50851,
 'downloader/response_status_count/200': 42687,
 'downloader/response_status_count/301': 6187,
 'downloader/response_status_count/403': 1942,
 'downloader/response_status_count/500': 22,
 'downloader/response_status_count/503': 1,
 'downloader/response_status_count/504': 12,
 'dupefilter/filtered': 223,
 'elapsed_time_seconds': 55810.396136,
 'feedexport/success_count/BigQueryFeedStorage': 1,
 'finish_reason': 'closespider_timeout_no_item',
 'finish_time': datetime.datetime(2026, 1, 4, 14, 30, 22, 761205, tzinfo=datetime.timezone.utc),
 'httpcompression/response_bytes': 3282205849,
 'httpcompression/response_count': 28684,
 'httperror/response_ignored_count': 11,
 'httperror/response_ignored_status_count/500': 7,
 'httperror/response_ignored_status_count/504': 4,
 'item_scraped_count': 951,
 'items_per_minute': None,
 'log_count/ERROR': 1172,
 'log_count/INFO': 985,
 'log_count/WARNING': 40883,
 'memusage/max': 430211072,
 'memusage/startup': 126042112,
 'parse_sesnapi/not-product-page': 5580,
 'poet/injector/catalog_extraction.pages.mcmaster_carr.McMasterCarrSingleProductPageObject': 1686,
 'proxy_manager/processed': 50930,
 'proxy_manager/session_attached': 50930,
 'renew_cat_cookie/10032': 3,
 'renew_cat_cookie/10050': 3,
 'renew_cat_cookie/10056': 3,
 'renew_cat_cookie/10059': 3,
 'renew_cat_cookie/10073': 3,
 'renew_cat_cookie/10077': 3,
 'renew_cat_cookie/10107': 3,
 'renew_cat_cookie/10131': 3,
 'renew_cat_cookie/10186': 3,
 'renew_cat_cookie/10200': 3,
 'renew_cat_cookie/10217': 3,
 'renew_cat_cookie/10239': 3,
 'renew_cat_cookie/10242': 3,
 'renew_cat_cookie/10257': 3,
 'renew_cat_cookie/10269': 3,
 'renew_cat_cookie/10271': 3,
 'renew_cat_cookie/10308': 3,
 'renew_cat_cookie/10310': 3,
 'renew_cat_cookie/10337': 3,
 'renew_cat_cookie/10373': 3,
 'renew_cat_cookie/10377': 3,
 'renew_cat_cookie/10389': 3,
 'renew_cat_cookie/10391': 3,
 'renew_cat_cookie/10396': 3,
 'renew_cat_cookie/10399': 3,
 'renew_cat_cookie/10428': 3,
 'renew_cat_cookie/10465': 3,
 'renew_cat_cookie/10472': 3,
 'renew_cat_cookie/10474': 3,
 'renew_cat_cookie/10486': 3,
 'renew_cat_cookie/10511': 3,
 'renew_cat_cookie/10537': 3,
 'renew_cat_cookie/10560': 3,
 'renew_cat_cookie/10581': 3,
 'renew_cat_cookie/10611': 3,
 'renew_cat_cookie/10644': 3,
 'renew_cat_cookie/10649': 3,
 'renew_cat_cookie/10676': 3,
 'renew_cat_cookie/10681': 3,
 'renew_cat_cookie/10696': 3,
 'renew_cat_cookie/10702': 3,
 'renew_cat_cookie/10719': 1,
 'renew_cat_cookie/10724': 3,
 'renew_cat_cookie/1073': 3,
 'renew_cat_cookie/10745': 3,
 'renew_cat_cookie/10760': 3,
 'renew_cat_cookie/10764': 3,
 'renew_cat_cookie/10785': 3,
 'renew_cat_cookie/10792': 3,
 'renew_cat_cookie/10800': 3,
 'renew_cat_cookie/10835': 3,
 'renew_cat_cookie/10865': 3,
 'renew_cat_cookie/10868': 3,
 'renew_cat_cookie/10892': 3,
 'renew_cat_cookie/10922': 3,
 'renew_cat_cookie/10972': 3,
 'renew_cat_cookie/11': 3,
 'renew_cat_cookie/11058': 3,
 'renew_cat_cookie/11068': 3,
 'renew_cat_cookie/11069': 3,
 'renew_cat_cookie/11071': 3,
 'renew_cat_cookie/11104': 3,
 'renew_cat_cookie/1113': 3,
 'renew_cat_cookie/11143': 3,
 'renew_cat_cookie/11160': 3,
 'renew_cat_cookie/11171': 3,
 'renew_cat_cookie/11183': 3,
 'renew_cat_cookie/11186': 3,
 'renew_cat_cookie/11196': 3,
 'renew_cat_cookie/11231': 3,
 'renew_cat_cookie/11235': 3,
 'renew_cat_cookie/11255': 3,
 'renew_cat_cookie/11262': 3,
 'renew_cat_cookie/11294': 3,
 'renew_cat_cookie/11303': 3,
 'renew_cat_cookie/11304': 3,
 'renew_cat_cookie/11307': 3,
 'renew_cat_cookie/1131': 3,
 'renew_cat_cookie/11311': 3,
 'renew_cat_cookie/11345': 3,
 'renew_cat_cookie/11350': 3,
 'renew_cat_cookie/11360': 3,
 'renew_cat_cookie/11366': 3,
 'renew_cat_cookie/11375': 3,
 'renew_cat_cookie/11378': 3,
 'renew_cat_cookie/11387': 3,
 'renew_cat_cookie/11449': 3,
 'renew_cat_cookie/11477': 3,
 'renew_cat_cookie/11486': 3,
 'renew_cat_cookie/1152': 3,
 'renew_cat_cookie/11530': 3,
 'renew_cat_cookie/11582': 3,
 'renew_cat_cookie/11600': 3,
 'renew_cat_cookie/11624': 3,
 'renew_cat_cookie/11630': 3,
 'renew_cat_cookie/11641': 3,
 'renew_cat_cookie/11643': 3,
 'renew_cat_cookie/11650': 3,
 'renew_cat_cookie/11651': 3,
 'renew_cat_cookie/11656': 3,
 'renew_cat_cookie/11664': 3,
 'renew_cat_cookie/11667': 3,
 'renew_cat_cookie/11670': 3,
 'renew_cat_cookie/11677': 3,
 'renew_cat_cookie/11732': 3,
 'renew_cat_cookie/11737': 3,
 'renew_cat_cookie/11741': 3,
 'renew_cat_cookie/11754': 3,
 'renew_cat_cookie/11755': 3,
 'renew_cat_cookie/11762': 3,
 'renew_cat_cookie/11765': 3,
 'renew_cat_cookie/11768': 3,
 'renew_cat_cookie/11771': 3,
 'renew_cat_cookie/11772': 3,
 'renew_cat_cookie/11803': 3,
 'renew_cat_cookie/11805': 3,
 'renew_cat_cookie/11813': 3,
 'renew_cat_cookie/11831': 3,
 'renew_cat_cookie/11835': 3,
 'renew_cat_cookie/11837': 3,
 'renew_cat_cookie/11843': 3,
 'renew_cat_cookie/11848': 3,
 'renew_cat_cookie/11851': 3,
 'renew_cat_cookie/11854': 3,
 'renew_cat_cookie/11855': 3,
 'renew_cat_cookie/11857': 3,
 'renew_cat_cookie/11859': 3,
 'renew_cat_cookie/11860': 3,
 'renew_cat_cookie/11863': 3,
 'renew_cat_cookie/11864': 3,
 'renew_cat_cookie/11866': 3,
 'renew_cat_cookie/11869': 3,
 'renew_cat_cookie/11884': 3,
 'renew_cat_cookie/1189': 3,
 'renew_cat_cookie/11890': 3,
 'renew_cat_cookie/11923': 3,
 'renew_cat_cookie/11944': 3,
 'renew_cat_cookie/11979': 3,
 'renew_cat_cookie/11991': 3,
 'renew_cat_cookie/11996': 3,
 'renew_cat_cookie/12000': 3,
 'renew_cat_cookie/12007': 3,
 'renew_cat_cookie/1201': 3,
 'renew_cat_cookie/12029': 3,
 'renew_cat_cookie/12062': 2,
 'renew_cat_cookie/12063': 3,
 'renew_cat_cookie/12070': 2,
 'renew_cat_cookie/12073': 1,
 'renew_cat_cookie/12074': 1,
 'renew_cat_cookie/12075': 1,
 'renew_cat_cookie/1208': 3,
 'renew_cat_cookie/1261': 3,
 'renew_cat_cookie/1296': 3,
 'renew_cat_cookie/1309': 3,
 'renew_cat_cookie/131': 3,
 'renew_cat_cookie/1329': 3,
 'renew_cat_cookie/1337': 3,
 'renew_cat_cookie/1344': 3,
 'renew_cat_cookie/1367': 3,
 'renew_cat_cookie/1377': 3,
 'renew_cat_cookie/1378': 3,
 'renew_cat_cookie/1420': 3,
 'renew_cat_cookie/1433': 3,
 'renew_cat_cookie/1434': 3,
 'renew_cat_cookie/1435': 3,
 'renew_cat_cookie/144': 3,
 'renew_cat_cookie/1441': 3,
 'renew_cat_cookie/1444': 3,
 'renew_cat_cookie/1482': 3,
 'renew_cat_cookie/1491': 3,
 'renew_cat_cookie/1515': 3,
 'renew_cat_cookie/1527': 3,
 'renew_cat_cookie/1529': 3,
 'renew_cat_cookie/1532': 3,
 'renew_cat_cookie/1534': 3,
 'renew_cat_cookie/1570': 3,
 'renew_cat_cookie/1586': 3,
 'renew_cat_cookie/1607': 3,
 'renew_cat_cookie/1788': 3,
 'renew_cat_cookie/1838': 3,
 'renew_cat_cookie/1844': 3,
 'renew_cat_cookie/1867': 3,
 'renew_cat_cookie/187': 3,
 'renew_cat_cookie/1891': 3,
 'renew_cat_cookie/192': 3,
 'renew_cat_cookie/1945': 3,
 'renew_cat_cookie/2052': 3,
 'renew_cat_cookie/2072': 3,
 'renew_cat_cookie/2076': 3,
 'renew_cat_cookie/211': 3,
 'renew_cat_cookie/213': 3,
 'renew_cat_cookie/217': 3,
 'renew_cat_cookie/2180': 3,
 'renew_cat_cookie/2193': 3,
 'renew_cat_cookie/2207': 3,
 'renew_cat_cookie/222': 3,
 'renew_cat_cookie/2221': 3,
 'renew_cat_cookie/2227': 3,
 'renew_cat_cookie/2245': 3,
 'renew_cat_cookie/2252': 3,
 'renew_cat_cookie/226': 3,
 'renew_cat_cookie/2292': 3,
 'renew_cat_cookie/2311': 3,
 'renew_cat_cookie/2323': 3,
 'renew_cat_cookie/2326': 3,
 'renew_cat_cookie/2338': 3,
 'renew_cat_cookie/2339': 3,
 'renew_cat_cookie/2373': 3,
 'renew_cat_cookie/2379': 3,
 'renew_cat_cookie/2384': 3,
 'renew_cat_cookie/2387': 3,
 'renew_cat_cookie/2400': 3,
 'renew_cat_cookie/241': 3,
 'renew_cat_cookie/2458': 3,
 'renew_cat_cookie/2468': 3,
 'renew_cat_cookie/2529': 3,
 'renew_cat_cookie/2559': 3,
 'renew_cat_cookie/2566': 3,
 'renew_cat_cookie/2570': 3,
 'renew_cat_cookie/2593': 3,
 'renew_cat_cookie/2605': 3,
 'renew_cat_cookie/2606': 3,
 'renew_cat_cookie/2669': 3,
 'renew_cat_cookie/2685': 3,
 'renew_cat_cookie/2702': 3,
 'renew_cat_cookie/2704': 3,
 'renew_cat_cookie/2714': 3,
 'renew_cat_cookie/2719': 3,
 'renew_cat_cookie/2745': 3,
 'renew_cat_cookie/277': 3,
 'renew_cat_cookie/2779': 3,
 'renew_cat_cookie/2780': 3,
 'renew_cat_cookie/2782': 3,
 'renew_cat_cookie/2786': 3,
 'renew_cat_cookie/2792': 3,
 'renew_cat_cookie/2801': 3,
 'renew_cat_cookie/281': 3,
 'renew_cat_cookie/2811': 3,
 'renew_cat_cookie/2825': 3,
 'renew_cat_cookie/2828': 3,
 'renew_cat_cookie/2829': 3,
 'renew_cat_cookie/2832': 3,
 'renew_cat_cookie/2839': 3,
 'renew_cat_cookie/2840': 3,
 'renew_cat_cookie/2846': 3,
 'renew_cat_cookie/2858': 3,
 'renew_cat_cookie/286': 3,
 'renew_cat_cookie/2866': 3,
 'renew_cat_cookie/2871': 3,
 'renew_cat_cookie/2873': 3,
 'renew_cat_cookie/2881': 3,
 'renew_cat_cookie/2882': 3,
 'renew_cat_cookie/2894': 3,
 'renew_cat_cookie/2914': 3,
 'renew_cat_cookie/298': 3,
 'renew_cat_cookie/2984': 3,
 'renew_cat_cookie/2989': 3,
 'renew_cat_cookie/2995': 3,
 'renew_cat_cookie/2999': 3,
 'renew_cat_cookie/30': 3,
 'renew_cat_cookie/3005': 3,
 'renew_cat_cookie/3020': 3,
 'renew_cat_cookie/303': 3,
 'renew_cat_cookie/3046': 3,
 'renew_cat_cookie/3075': 3,
 'renew_cat_cookie/3094': 3,
 'renew_cat_cookie/3154': 3,
 'renew_cat_cookie/319': 3,
 'renew_cat_cookie/3239': 3,
 'renew_cat_cookie/3307': 3,
 'renew_cat_cookie/3325': 3,
 'renew_cat_cookie/3355': 3,
 'renew_cat_cookie/3368': 3,
 'renew_cat_cookie/3397': 3,
 'renew_cat_cookie/3400': 3,
 'renew_cat_cookie/3465': 3,
 'renew_cat_cookie/3468': 3,
 'renew_cat_cookie/3470': 3,
 'renew_cat_cookie/3472': 3,
 'renew_cat_cookie/3484': 3,
 'renew_cat_cookie/3502': 3,
 'renew_cat_cookie/3534': 3,
 'renew_cat_cookie/3568': 3,
 'renew_cat_cookie/3579': 3,
 'renew_cat_cookie/3592': 3,
 'renew_cat_cookie/3621': 3,
 'renew_cat_cookie/364': 3,
 'renew_cat_cookie/3640': 3,
 'renew_cat_cookie/3641': 3,
 'renew_cat_cookie/3692': 3,
 'renew_cat_cookie/3721': 3,
 'renew_cat_cookie/3727': 3,
 'renew_cat_cookie/3740': 3,
 'renew_cat_cookie/3767': 3,
 'renew_cat_cookie/3800': 3,
 'renew_cat_cookie/381': 3,
 'renew_cat_cookie/3828': 3,
 'renew_cat_cookie/383': 3,
 'renew_cat_cookie/3832': 3,
 'renew_cat_cookie/3862': 3,
 'renew_cat_cookie/3863': 3,
 'renew_cat_cookie/3918': 3,
 'renew_cat_cookie/3930': 3,
 'renew_cat_cookie/3950': 3,
 'renew_cat_cookie/3953': 3,
 'renew_cat_cookie/3955': 3,
 'renew_cat_cookie/3972': 3,
 'renew_cat_cookie/3984': 3,
 'renew_cat_cookie/3989': 3,
 'renew_cat_cookie/4': 3,
 'renew_cat_cookie/4003': 3,
 'renew_cat_cookie/4015': 3,
 'renew_cat_cookie/4032': 3,
 'renew_cat_cookie/4087': 3,
 'renew_cat_cookie/4106': 3,
 'renew_cat_cookie/4112': 3,
 'renew_cat_cookie/413': 3,
 'renew_cat_cookie/4131': 3,
 'renew_cat_cookie/415': 3,
 'renew_cat_cookie/4151': 3,
 'renew_cat_cookie/4158': 3,
 'renew_cat_cookie/4159': 3,
 'renew_cat_cookie/4185': 3,
 'renew_cat_cookie/419': 3,
 'renew_cat_cookie/4204': 3,
 'renew_cat_cookie/4211': 3,
 'renew_cat_cookie/4228': 3,
 'renew_cat_cookie/4239': 3,
 'renew_cat_cookie/4243': 3,
 'renew_cat_cookie/4247': 3,
 'renew_cat_cookie/4251': 3,
 'renew_cat_cookie/4259': 3,
 'renew_cat_cookie/4283': 3,
 'renew_cat_cookie/431': 3,
 'renew_cat_cookie/4327': 3,
 'renew_cat_cookie/4330': 3,
 'renew_cat_cookie/4335': 3,
 'renew_cat_cookie/4379': 3,
 'renew_cat_cookie/4426': 3,
 'renew_cat_cookie/4427': 3,
 'renew_cat_cookie/444': 3,
 'renew_cat_cookie/4476': 3,
 'renew_cat_cookie/450': 3,
 'renew_cat_cookie/4504': 3,
 'renew_cat_cookie/4579': 3,
 'renew_cat_cookie/4587': 3,
 'renew_cat_cookie/4617': 3,
 'renew_cat_cookie/4622': 3,
 'renew_cat_cookie/464': 3,
 'renew_cat_cookie/4653': 3,
 'renew_cat_cookie/4659': 3,
 'renew_cat_cookie/4687': 3,
 'renew_cat_cookie/4691': 3,
 'renew_cat_cookie/4697': 3,
 'renew_cat_cookie/4714': 3,
 'renew_cat_cookie/4739': 3,
 'renew_cat_cookie/4741': 3,
 'renew_cat_cookie/475': 3,
 'renew_cat_cookie/4777': 3,
 'renew_cat_cookie/478': 3,
 'renew_cat_cookie/4780': 3,
 'renew_cat_cookie/4826': 3,
 'renew_cat_cookie/4846': 3,
 'renew_cat_cookie/4854': 3,
 'renew_cat_cookie/4857': 3,
 'renew_cat_cookie/4862': 3,
 'renew_cat_cookie/4865': 3,
 'renew_cat_cookie/4869': 3,
 'renew_cat_cookie/4888': 3,
 'renew_cat_cookie/4898': 3,
 'renew_cat_cookie/4905': 3,
 'renew_cat_cookie/4922': 3,
 'renew_cat_cookie/4923': 3,
 'renew_cat_cookie/4925': 3,
 'renew_cat_cookie/4942': 3,
 'renew_cat_cookie/4946': 3,
 'renew_cat_cookie/4970': 1,
 'renew_cat_cookie/4990': 3,
 'renew_cat_cookie/4998': 3,
 'renew_cat_cookie/4999': 3,
 'renew_cat_cookie/5042': 3,
 'renew_cat_cookie/5048': 3,
 'renew_cat_cookie/5051': 3,
 'renew_cat_cookie/5053': 3,
 'renew_cat_cookie/5091': 3,
 'renew_cat_cookie/5094': 3,
 'renew_cat_cookie/5133': 3,
 'renew_cat_cookie/5135': 3,
 'renew_cat_cookie/5137': 3,
 'renew_cat_cookie/5140': 3,
 'renew_cat_cookie/5147': 3,
 'renew_cat_cookie/5156': 3,
 'renew_cat_cookie/5207': 3,
 'renew_cat_cookie/5224': 3,
 'renew_cat_cookie/5225': 3,
 'renew_cat_cookie/5261': 3,
 'renew_cat_cookie/5266': 3,
 'renew_cat_cookie/5272': 3,
 'renew_cat_cookie/5286': 3,
 'renew_cat_cookie/5288': 3,
 'renew_cat_cookie/5295': 3,
 'renew_cat_cookie/5310': 3,
 'renew_cat_cookie/5328': 3,
 'renew_cat_cookie/5330': 3,
 'renew_cat_cookie/5337': 3,
 'renew_cat_cookie/5350': 3,
 'renew_cat_cookie/5368': 3,
 'renew_cat_cookie/5370': 3,
 'renew_cat_cookie/5371': 3,
 'renew_cat_cookie/5379': 3,
 'renew_cat_cookie/5403': 3,
 'renew_cat_cookie/5452': 3,
 'renew_cat_cookie/5470': 3,
 'renew_cat_cookie/5486': 3,
 'renew_cat_cookie/5498': 3,
 'renew_cat_cookie/5499': 3,
 'renew_cat_cookie/5532': 3,
 'renew_cat_cookie/5536': 3,
 'renew_cat_cookie/5541': 3,
 'renew_cat_cookie/555': 3,
 'renew_cat_cookie/557': 3,
 'renew_cat_cookie/5570': 3,
 'renew_cat_cookie/5604': 3,
 'renew_cat_cookie/5607': 3,
 'renew_cat_cookie/5648': 3,
 'renew_cat_cookie/568': 3,
 'renew_cat_cookie/5680': 3,
 'renew_cat_cookie/5770': 3,
 'renew_cat_cookie/5784': 3,
 'renew_cat_cookie/5799': 3,
 'renew_cat_cookie/5801': 3,
 'renew_cat_cookie/5811': 3,
 'renew_cat_cookie/5820': 3,
 'renew_cat_cookie/5829': 3,
 'renew_cat_cookie/5873': 3,
 'renew_cat_cookie/5922': 3,
 'renew_cat_cookie/5954': 3,
 'renew_cat_cookie/5959': 3,
 'renew_cat_cookie/5962': 3,
 'renew_cat_cookie/5989': 3,
 'renew_cat_cookie/6015': 3,
 'renew_cat_cookie/6028': 3,
 'renew_cat_cookie/6038': 3,
 'renew_cat_cookie/6049': 3,
 'renew_cat_cookie/6059': 3,
 'renew_cat_cookie/608': 3,
 'renew_cat_cookie/6080': 3,
 'renew_cat_cookie/6177': 3,
 'renew_cat_cookie/6211': 3,
 'renew_cat_cookie/6225': 3,
 'renew_cat_cookie/623': 3,
 'renew_cat_cookie/6248': 3,
 'renew_cat_cookie/6253': 3,
 'renew_cat_cookie/6258': 3,
 'renew_cat_cookie/6263': 3,
 'renew_cat_cookie/6270': 3,
 'renew_cat_cookie/6273': 3,
 'renew_cat_cookie/6282': 3,
 'renew_cat_cookie/6283': 3,
 'renew_cat_cookie/6310': 3,
 'renew_cat_cookie/6348': 3,
 'renew_cat_cookie/6357': 3,
 'renew_cat_cookie/6399': 3,
 'renew_cat_cookie/6402': 3,
 'renew_cat_cookie/6414': 3,
 'renew_cat_cookie/6489': 2,
 'renew_cat_cookie/6498': 3,
 'renew_cat_cookie/6522': 3,
 'renew_cat_cookie/6526': 3,
 'renew_cat_cookie/6529': 3,
 'renew_cat_cookie/6546': 3,
 'renew_cat_cookie/6567': 3,
 'renew_cat_cookie/6581': 3,
 'renew_cat_cookie/6602': 3,
 'renew_cat_cookie/6608': 3,
 'renew_cat_cookie/6645': 3,
 'renew_cat_cookie/6698': 3,
 'renew_cat_cookie/6803': 3,
 'renew_cat_cookie/6805': 3,
 'renew_cat_cookie/6807': 3,
 'renew_cat_cookie/6833': 3,
 'renew_cat_cookie/6856': 3,
 'renew_cat_cookie/6870': 3,
 'renew_cat_cookie/6875': 3,
 'renew_cat_cookie/692': 3,
 'renew_cat_cookie/6937': 3,
 'renew_cat_cookie/7010': 3,
 'renew_cat_cookie/7012': 3,
 'renew_cat_cookie/7028': 3,
 'renew_cat_cookie/7070': 3,
 'renew_cat_cookie/7084': 3,
 'renew_cat_cookie/7086': 3,
 'renew_cat_cookie/7133': 3,
 'renew_cat_cookie/7198': 3,
 'renew_cat_cookie/7235': 3,
 'renew_cat_cookie/7236': 3,
 'renew_cat_cookie/7260': 3,
 'renew_cat_cookie/7265': 3,
 'renew_cat_cookie/7274': 3,
 'renew_cat_cookie/7314': 3,
 'renew_cat_cookie/7318': 2,
 'renew_cat_cookie/7323': 3,
 'renew_cat_cookie/7346': 3,
 'renew_cat_cookie/7352': 3,
 'renew_cat_cookie/7391': 3,
 'renew_cat_cookie/7392': 3,
 'renew_cat_cookie/7396': 3,
 'renew_cat_cookie/7401': 3,
 'renew_cat_cookie/744': 3,
 'renew_cat_cookie/75': 3,
 'renew_cat_cookie/7613': 3,
 'renew_cat_cookie/7617': 3,
 'renew_cat_cookie/7649': 3,
 'renew_cat_cookie/7657': 3,
 'renew_cat_cookie/766': 3,
 'renew_cat_cookie/7673': 3,
 'renew_cat_cookie/7687': 3,
 'renew_cat_cookie/77': 3,
 'renew_cat_cookie/772': 3,
 'renew_cat_cookie/7734': 3,
 'renew_cat_cookie/7737': 3,
 'renew_cat_cookie/7746': 3,
 'renew_cat_cookie/7770': 3,
 'renew_cat_cookie/7779': 3,
 'renew_cat_cookie/7811': 3,
 'renew_cat_cookie/7816': 3,
 'renew_cat_cookie/7857': 3,
 'renew_cat_cookie/7893': 3,
 'renew_cat_cookie/7909': 3,
 'renew_cat_cookie/7913': 3,
 'renew_cat_cookie/7920': 3,
 'renew_cat_cookie/7943': 3,
 'renew_cat_cookie/7959': 3,
 'renew_cat_cookie/8056': 3,
 'renew_cat_cookie/8067': 3,
 'renew_cat_cookie/807': 3,
 'renew_cat_cookie/8102': 3,
 'renew_cat_cookie/8120': 3,
 'renew_cat_cookie/8139': 3,
 'renew_cat_cookie/8169': 3,
 'renew_cat_cookie/818': 3,
 'renew_cat_cookie/8206': 3,
 'renew_cat_cookie/8227': 3,
 'renew_cat_cookie/8243': 3,
 'renew_cat_cookie/8258': 3,
 'renew_cat_cookie/8261': 3,
 'renew_cat_cookie/8290': 3,
 'renew_cat_cookie/8306': 3,
 'renew_cat_cookie/8316': 3,
 'renew_cat_cookie/8349': 3,
 'renew_cat_cookie/8374': 3,
 'renew_cat_cookie/838': 3,
 'renew_cat_cookie/8417': 3,
 'renew_cat_cookie/8421': 3,
 'renew_cat_cookie/8435': 3,
 'renew_cat_cookie/8443': 3,
 'renew_cat_cookie/8446': 3,
 'renew_cat_cookie/8467': 3,
 'renew_cat_cookie/847': 3,
 'renew_cat_cookie/8470': 3,
 'renew_cat_cookie/8528': 3,
 'renew_cat_cookie/8571': 3,
 'renew_cat_cookie/8579': 3,
 'renew_cat_cookie/8590': 3,
 'renew_cat_cookie/8600': 3,
 'renew_cat_cookie/8610': 3,
 'renew_cat_cookie/8611': 3,
 'renew_cat_cookie/8614': 3,
 'renew_cat_cookie/8626': 3,
 'renew_cat_cookie/8639': 3,
 'renew_cat_cookie/8655': 3,
 'renew_cat_cookie/8663': 3,
 'renew_cat_cookie/8673': 3,
 'renew_cat_cookie/8694': 3,
 'renew_cat_cookie/8699': 3,
 'renew_cat_cookie/8702': 3,
 'renew_cat_cookie/8734': 3,
 'renew_cat_cookie/8771': 3,
 'renew_cat_cookie/8775': 3,
 'renew_cat_cookie/882': 3,
 'renew_cat_cookie/8830': 3,
 'renew_cat_cookie/8838': 3,
 'renew_cat_cookie/8868': 3,
 'renew_cat_cookie/8877': 3,
 'renew_cat_cookie/8886': 3,
 'renew_cat_cookie/8903': 3,
 'renew_cat_cookie/8936': 3,
 'renew_cat_cookie/8942': 3,
 'renew_cat_cookie/8951': 3,
 'renew_cat_cookie/8962': 3,
 'renew_cat_cookie/8963': 3,
 'renew_cat_cookie/8971': 3,
 'renew_cat_cookie/8977': 3,
 'renew_cat_cookie/900': 3,
 'renew_cat_cookie/9004': 3,
 'renew_cat_cookie/9026': 3,
 'renew_cat_cookie/9032': 3,
 'renew_cat_cookie/9056': 3,
 'renew_cat_cookie/91': 3,
 'renew_cat_cookie/9101': 3,
 'renew_cat_cookie/9148': 3,
 'renew_cat_cookie/9158': 3,
 'renew_cat_cookie/9161': 3,
 'renew_cat_cookie/9162': 3,
 'renew_cat_cookie/9179': 3,
 'renew_cat_cookie/9183': 3,
 'renew_cat_cookie/922': 3,
 'renew_cat_cookie/928': 3,
 'renew_cat_cookie/9287': 3,
 'renew_cat_cookie/9329': 3,
 'renew_cat_cookie/9341': 3,
 'renew_cat_cookie/9362': 3,
 'renew_cat_cookie/9367': 3,
 'renew_cat_cookie/9368': 3,
 'renew_cat_cookie/9370': 3,
 'renew_cat_cookie/9372': 3,
 'renew_cat_cookie/9414': 3,
 'renew_cat_cookie/9419': 3,
 'renew_cat_cookie/9427': 3,
 'renew_cat_cookie/9439': 3,
 'renew_cat_cookie/9560': 3,
 'renew_cat_cookie/9567': 3,
 'renew_cat_cookie/9571': 3,
 'renew_cat_cookie/9588': 3,
 'renew_cat_cookie/9590': 3,
 'renew_cat_cookie/9598': 3,
 'renew_cat_cookie/9610': 3,
 'renew_cat_cookie/9615': 3,
 'renew_cat_cookie/9626': 3,
 'renew_cat_cookie/9628': 3,
 'renew_cat_cookie/9640': 3,
 'renew_cat_cookie/9656': 3,
 'renew_cat_cookie/9676': 3,
 'renew_cat_cookie/968': 3,
 'renew_cat_cookie/9727': 3,
 'renew_cat_cookie/9748': 3,
 'renew_cat_cookie/9763': 3,
 'renew_cat_cookie/9784': 3,
 'renew_cat_cookie/9795': 3,
 'renew_cat_cookie/9796': 3,
 'renew_cat_cookie/9828': 3,
 'renew_cat_cookie/9841': 3,
 'renew_cat_cookie/9844': 3,
 'renew_cat_cookie/9869': 3,
 'renew_cat_cookie/9948': 3,
 'renew_cat_cookie/995': 3,
 'renew_cat_cookie/9954': 3,
 'renew_cat_cookie/9959': 3,
 'renew_cat_cookie/9975': 3,
 'renew_cat_cookie/9978': 3,
 'renew_cat_cookie/9979': 3,
 'renew_cat_cookie/9990': 3,
 'renewed_cat_cookie/10032': 3,
 'renewed_cat_cookie/10050': 3,
 'renewed_cat_cookie/10056': 3,
 'renewed_cat_cookie/10059': 3,
 'renewed_cat_cookie/10073': 3,
 'renewed_cat_cookie/10077': 3,
 'renewed_cat_cookie/10107': 3,
 'renewed_cat_cookie/10131': 3,
 'renewed_cat_cookie/10186': 3,
 'renewed_cat_cookie/10200': 3,
 'renewed_cat_cookie/10217': 3,
 'renewed_cat_cookie/10239': 3,
 'renewed_cat_cookie/10242': 3,
 'renewed_cat_cookie/10257': 3,
 'renewed_cat_cookie/10269': 3,
 'renewed_cat_cookie/10271': 3,
 'renewed_cat_cookie/10308': 3,
 'renewed_cat_cookie/10310': 3,
 'renewed_cat_cookie/10337': 3,
 'renewed_cat_cookie/10373': 3,
 'renewed_cat_cookie/10377': 3,
 'renewed_cat_cookie/10389': 3,
 'renewed_cat_cookie/10391': 3,
 'renewed_cat_cookie/10396': 3,
 'renewed_cat_cookie/10399': 3,
 'renewed_cat_cookie/10428': 3,
 'renewed_cat_cookie/10465': 3,
 'renewed_cat_cookie/10472': 3,
 'renewed_cat_cookie/10474': 3,
 'renewed_cat_cookie/10486': 3,
 'renewed_cat_cookie/10511': 3,
 'renewed_cat_cookie/10537': 3,
 'renewed_cat_cookie/10560': 3,
 'renewed_cat_cookie/10581': 3,
 'renewed_cat_cookie/10611': 3,
 'renewed_cat_cookie/10644': 3,
 'renewed_cat_cookie/10649': 3,
 'renewed_cat_cookie/10676': 3,
 'renewed_cat_cookie/10681': 3,
 'renewed_cat_cookie/10696': 3,
 'renewed_cat_cookie/10702': 3,
 'renewed_cat_cookie/10719': 1,
 'renewed_cat_cookie/10724': 3,
 'renewed_cat_cookie/1073': 3,
 'renewed_cat_cookie/10745': 3,
 'renewed_cat_cookie/10760': 3,
 'renewed_cat_cookie/10764': 3,
 'renewed_cat_cookie/10785': 3,
 'renewed_cat_cookie/10792': 3,
 'renewed_cat_cookie/10800': 3,
 'renewed_cat_cookie/10835': 3,
 'renewed_cat_cookie/10865': 3,
 'renewed_cat_cookie/10868': 3,
 'renewed_cat_cookie/10892': 3,
 'renewed_cat_cookie/10922': 3,
 'renewed_cat_cookie/10972': 3,
 'renewed_cat_cookie/11': 3,
 'renewed_cat_cookie/11058': 3,
 'renewed_cat_cookie/11068': 3,
 'renewed_cat_cookie/11069': 3,
 'renewed_cat_cookie/11071': 3,
 'renewed_cat_cookie/11104': 3,
 'renewed_cat_cookie/1113': 3,
 'renewed_cat_cookie/11143': 3,
 'renewed_cat_cookie/11160': 3,
 'renewed_cat_cookie/11171': 3,
 'renewed_cat_cookie/11183': 3,
 'renewed_cat_cookie/11186': 3,
 'renewed_cat_cookie/11196': 3,
 'renewed_cat_cookie/11231': 3,
 'renewed_cat_cookie/11235': 3,
 'renewed_cat_cookie/11255': 3,
 'renewed_cat_cookie/11262': 3,
 'renewed_cat_cookie/11294': 3,
 'renewed_cat_cookie/11303': 3,
 'renewed_cat_cookie/11304': 3,
 'renewed_cat_cookie/11307': 3,
 'renewed_cat_cookie/1131': 3,
 'renewed_cat_cookie/11311': 3,
 'renewed_cat_cookie/11345': 3,
 'renewed_cat_cookie/11350': 3,
 'renewed_cat_cookie/11360': 3,
 'renewed_cat_cookie/11366': 3,
 'renewed_cat_cookie/11375': 3,
 'renewed_cat_cookie/11378': 3,
 'renewed_cat_cookie/11387': 3,
 'renewed_cat_cookie/11449': 3,
 'renewed_cat_cookie/11477': 3,
 'renewed_cat_cookie/11486': 3,
 'renewed_cat_cookie/1152': 3,
 'renewed_cat_cookie/11530': 3,
 'renewed_cat_cookie/11582': 3,
 'renewed_cat_cookie/11600': 3,
 'renewed_cat_cookie/11624': 3,
 'renewed_cat_cookie/11630': 3,
 'renewed_cat_cookie/11641': 3,
 'renewed_cat_cookie/11643': 3,
 'renewed_cat_cookie/11650': 3,
 'renewed_cat_cookie/11651': 3,
 'renewed_cat_cookie/11656': 3,
 'renewed_cat_cookie/11664': 3,
 'renewed_cat_cookie/11667': 3,
 'renewed_cat_cookie/11670': 3,
 'renewed_cat_cookie/11677': 3,
 'renewed_cat_cookie/11732': 3,
 'renewed_cat_cookie/11737': 3,
 'renewed_cat_cookie/11741': 3,
 'renewed_cat_cookie/11754': 3,
 'renewed_cat_cookie/11755': 3,
 'renewed_cat_cookie/11762': 3,
 'renewed_cat_cookie/11765': 3,
 'renewed_cat_cookie/11768': 3,
 'renewed_cat_cookie/11771': 3,
 'renewed_cat_cookie/11772': 3,
 'renewed_cat_cookie/11803': 3,
 'renewed_cat_cookie/11805': 3,
 'renewed_cat_cookie/11813': 3,
 'renewed_cat_cookie/11831': 3,
 'renewed_cat_cookie/11835': 3,
 'renewed_cat_cookie/11837': 3,
 'renewed_cat_cookie/11843': 3,
 'renewed_cat_cookie/11848': 3,
 'renewed_cat_cookie/11851': 3,
 'renewed_cat_cookie/11854': 3,
 'renewed_cat_cookie/11855': 3,
 'renewed_cat_cookie/11857': 3,
 'renewed_cat_cookie/11859': 3,
 'renewed_cat_cookie/11860': 3,
 'renewed_cat_cookie/11863': 3,
 'renewed_cat_cookie/11864': 3,
 'renewed_cat_cookie/11866': 3,
 'renewed_cat_cookie/11869': 3,
 'renewed_cat_cookie/11884': 3,
 'renewed_cat_cookie/1189': 3,
 'renewed_cat_cookie/11890': 3,
 'renewed_cat_cookie/11923': 3,
 'renewed_cat_cookie/11944': 3,
 'renewed_cat_cookie/11979': 3,
 'renewed_cat_cookie/11991': 3,
 'renewed_cat_cookie/11996': 3,
 'renewed_cat_cookie/12000': 3,
 'renewed_cat_cookie/12007': 3,
 'renewed_cat_cookie/1201': 3,
 'renewed_cat_cookie/12029': 3,
 'renewed_cat_cookie/12062': 1,
 'renewed_cat_cookie/12063': 2,
 'renewed_cat_cookie/12070': 1,
 'renewed_cat_cookie/1208': 3,
 'renewed_cat_cookie/1261': 3,
 'renewed_cat_cookie/1296': 3,
 'renewed_cat_cookie/1309': 3,
 'renewed_cat_cookie/131': 3,
 'renewed_cat_cookie/1329': 3,
 'renewed_cat_cookie/1337': 3,
 'renewed_cat_cookie/1344': 3,
 'renewed_cat_cookie/1367': 3,
 'renewed_cat_cookie/1377': 3,
 'renewed_cat_cookie/1378': 3,
 'renewed_cat_cookie/1420': 3,
 'renewed_cat_cookie/1433': 3,
 'renewed_cat_cookie/1434': 3,
 'renewed_cat_cookie/1435': 3,
 'renewed_cat_cookie/144': 3,
 'renewed_cat_cookie/1441': 3,
 'renewed_cat_cookie/1444': 3,
 'renewed_cat_cookie/1482': 3,
 'renewed_cat_cookie/1491': 3,
 'renewed_cat_cookie/1515': 3,
 'renewed_cat_cookie/1527': 3,
 'renewed_cat_cookie/1529': 3,
 'renewed_cat_cookie/1532': 3,
 'renewed_cat_cookie/1534': 3,
 'renewed_cat_cookie/1570': 3,
 'renewed_cat_cookie/1586': 3,
 'renewed_cat_cookie/1607': 3,
 'renewed_cat_cookie/1788': 3,
 'renewed_cat_cookie/1838': 3,
 'renewed_cat_cookie/1844': 3,
 'renewed_cat_cookie/1867': 3,
 'renewed_cat_cookie/187': 3,
 'renewed_cat_cookie/1891': 3,
 'renewed_cat_cookie/192': 3,
 'renewed_cat_cookie/1945': 3,
 'renewed_cat_cookie/2052': 3,
 'renewed_cat_cookie/2072': 3,
 'renewed_cat_cookie/2076': 3,
 'renewed_cat_cookie/211': 3,
 'renewed_cat_cookie/213': 3,
 'renewed_cat_cookie/217': 3,
 'renewed_cat_cookie/2180': 3,
 'renewed_cat_cookie/2193': 3,
 'renewed_cat_cookie/2207': 3,
 'renewed_cat_cookie/222': 3,
 'renewed_cat_cookie/2221': 3,
 'renewed_cat_cookie/2227': 3,
 'renewed_cat_cookie/2245': 3,
 'renewed_cat_cookie/2252': 3,
 'renewed_cat_cookie/226': 3,
 'renewed_cat_cookie/2292': 3,
 'renewed_cat_cookie/2311': 3,
 'renewed_cat_cookie/2323': 3,
 'renewed_cat_cookie/2326': 3,
 'renewed_cat_cookie/2338': 3,
 'renewed_cat_cookie/2339': 3,
 'renewed_cat_cookie/2373': 3,
 'renewed_cat_cookie/2379': 3,
 'renewed_cat_cookie/2384': 3,
 'renewed_cat_cookie/2387': 3,
 'renewed_cat_cookie/2400': 3,
 'renewed_cat_cookie/241': 3,
 'renewed_cat_cookie/2458': 3,
 'renewed_cat_cookie/2468': 3,
 'renewed_cat_cookie/2529': 3,
 'renewed_cat_cookie/2559': 3,
 'renewed_cat_cookie/2566': 3,
 'renewed_cat_cookie/2570': 3,
 'renewed_cat_cookie/2593': 3,
 'renewed_cat_cookie/2605': 3,
 'renewed_cat_cookie/2606': 3,
 'renewed_cat_cookie/2669': 3,
 'renewed_cat_cookie/2685': 3,
 'renewed_cat_cookie/2702': 3,
 'renewed_cat_cookie/2704': 3,
 'renewed_cat_cookie/2714': 3,
 'renewed_cat_cookie/2719': 3,
 'renewed_cat_cookie/2745': 3,
 'renewed_cat_cookie/277': 3,
 'renewed_cat_cookie/2779': 3,
 'renewed_cat_cookie/2780': 3,
 'renewed_cat_cookie/2782': 3,
 'renewed_cat_cookie/2786': 3,
 'renewed_cat_cookie/2792': 3,
 'renewed_cat_cookie/2801': 3,
 'renewed_cat_cookie/281': 3,
 'renewed_cat_cookie/2811': 3,
 'renewed_cat_cookie/2825': 3,
 'renewed_cat_cookie/2828': 3,
 'renewed_cat_cookie/2829': 3,
 'renewed_cat_cookie/2832': 3,
 'renewed_cat_cookie/2839': 3,
 'renewed_cat_cookie/2840': 3,
 'renewed_cat_cookie/2846': 3,
 'renewed_cat_cookie/2858': 3,
 'renewed_cat_cookie/286': 3,
 'renewed_cat_cookie/2866': 3,
 'renewed_cat_cookie/2871': 3,
 'renewed_cat_cookie/2873': 3,
 'renewed_cat_cookie/2881': 3,
 'renewed_cat_cookie/2882': 3,
 'renewed_cat_cookie/2894': 3,
 'renewed_cat_cookie/2914': 3,
 'renewed_cat_cookie/298': 3,
 'renewed_cat_cookie/2984': 3,
 'renewed_cat_cookie/2989': 3,
 'renewed_cat_cookie/2995': 3,
 'renewed_cat_cookie/2999': 3,
 'renewed_cat_cookie/30': 3,
 'renewed_cat_cookie/3005': 3,
 'renewed_cat_cookie/3020': 3,
 'renewed_cat_cookie/303': 3,
 'renewed_cat_cookie/3046': 3,
 'renewed_cat_cookie/3075': 3,
 'renewed_cat_cookie/3094': 3,
 'renewed_cat_cookie/3154': 3,
 'renewed_cat_cookie/319': 3,
 'renewed_cat_cookie/3239': 3,
 'renewed_cat_cookie/3307': 3,
 'renewed_cat_cookie/3325': 3,
 'renewed_cat_cookie/3355': 3,
 'renewed_cat_cookie/3368': 3,
 'renewed_cat_cookie/3397': 3,
 'renewed_cat_cookie/3400': 3,
 'renewed_cat_cookie/3465': 3,
 'renewed_cat_cookie/3468': 3,
 'renewed_cat_cookie/3470': 3,
 'renewed_cat_cookie/3472': 3,
 'renewed_cat_cookie/3484': 3,
 'renewed_cat_cookie/3502': 3,
 'renewed_cat_cookie/3534': 3,
 'renewed_cat_cookie/3568': 3,
 'renewed_cat_cookie/3579': 3,
 'renewed_cat_cookie/3592': 3,
 'renewed_cat_cookie/3621': 3,
 'renewed_cat_cookie/364': 3,
 'renewed_cat_cookie/3640': 3,
 'renewed_cat_cookie/3641': 3,
 'renewed_cat_cookie/3692': 3,
 'renewed_cat_cookie/3721': 3,
 'renewed_cat_cookie/3727': 3,
 'renewed_cat_cookie/3740': 3,
 'renewed_cat_cookie/3767': 3,
 'renewed_cat_cookie/3800': 3,
 'renewed_cat_cookie/381': 3,
 'renewed_cat_cookie/3828': 3,
 'renewed_cat_cookie/383': 3,
 'renewed_cat_cookie/3832': 3,
 'renewed_cat_cookie/3862': 3,
 'renewed_cat_cookie/3863': 3,
 'renewed_cat_cookie/3918': 3,
 'renewed_cat_cookie/3930': 3,
 'renewed_cat_cookie/3950': 3,
 'renewed_cat_cookie/3953': 3,
 'renewed_cat_cookie/3955': 3,
 'renewed_cat_cookie/3972': 3,
 'renewed_cat_cookie/3984': 3,
 'renewed_cat_cookie/3989': 3,
 'renewed_cat_cookie/4': 3,
 'renewed_cat_cookie/4003': 3,
 'renewed_cat_cookie/4015': 3,
 'renewed_cat_cookie/4032': 3,
 'renewed_cat_cookie/4087': 3,
 'renewed_cat_cookie/4106': 3,
 'renewed_cat_cookie/4112': 3,
 'renewed_cat_cookie/413': 3,
 'renewed_cat_cookie/4131': 3,
 'renewed_cat_cookie/415': 3,
 'renewed_cat_cookie/4151': 3,
 'renewed_cat_cookie/4158': 3,
 'renewed_cat_cookie/4159': 3,
 'renewed_cat_cookie/4185': 3,
 'renewed_cat_cookie/419': 3,
 'renewed_cat_cookie/4204': 3,
 'renewed_cat_cookie/4211': 3,
 'renewed_cat_cookie/4228': 3,
 'renewed_cat_cookie/4239': 3,
 'renewed_cat_cookie/4243': 3,
 'renewed_cat_cookie/4247': 3,
 'renewed_cat_cookie/4251': 3,
 'renewed_cat_cookie/4259': 3,
 'renewed_cat_cookie/4283': 3,
 'renewed_cat_cookie/431': 3,
 'renewed_cat_cookie/4327': 3,
 'renewed_cat_cookie/4330': 3,
 'renewed_cat_cookie/4335': 3,
 'renewed_cat_cookie/4379': 3,
 'renewed_cat_cookie/4426': 3,
 'renewed_cat_cookie/4427': 3,
 'renewed_cat_cookie/444': 3,
 'renewed_cat_cookie/4476': 3,
 'renewed_cat_cookie/450': 3,
 'renewed_cat_cookie/4504': 3,
 'renewed_cat_cookie/4579': 3,
 'renewed_cat_cookie/4587': 3,
 'renewed_cat_cookie/4617': 3,
 'renewed_cat_cookie/4622': 3,
 'renewed_cat_cookie/464': 3,
 'renewed_cat_cookie/4653': 3,
 'renewed_cat_cookie/4659': 3,
 'renewed_cat_cookie/4687': 3,
 'renewed_cat_cookie/4691': 3,
 'renewed_cat_cookie/4697': 3,
 'renewed_cat_cookie/4714': 3,
 'renewed_cat_cookie/4739': 3,
 'renewed_cat_cookie/4741': 3,
 'renewed_cat_cookie/475': 3,
 'renewed_cat_cookie/4777': 3,
 'renewed_cat_cookie/478': 3,
 'renewed_cat_cookie/4780': 3,
 'renewed_cat_cookie/4826': 3,
 'renewed_cat_cookie/4846': 3,
 'renewed_cat_cookie/4854': 3,
 'renewed_cat_cookie/4857': 3,
 'renewed_cat_cookie/4862': 3,
 'renewed_cat_cookie/4865': 3,
 'renewed_cat_cookie/4869': 3,
 'renewed_cat_cookie/4888': 3,
 'renewed_cat_cookie/4898': 3,
 'renewed_cat_cookie/4905': 3,
 'renewed_cat_cookie/4922': 3,
 'renewed_cat_cookie/4923': 3,
 'renewed_cat_cookie/4925': 3,
 'renewed_cat_cookie/4942': 3,
 'renewed_cat_cookie/4946': 3,
 'renewed_cat_cookie/4970': 1,
 'renewed_cat_cookie/4990': 3,
 'renewed_cat_cookie/4998': 3,
 'renewed_cat_cookie/4999': 3,
 'renewed_cat_cookie/5042': 3,
 'renewed_cat_cookie/5048': 3,
 'renewed_cat_cookie/5051': 3,
 'renewed_cat_cookie/5053': 3,
 'renewed_cat_cookie/5091': 3,
 'renewed_cat_cookie/5094': 3,
 'renewed_cat_cookie/5133': 3,
 'renewed_cat_cookie/5135': 3,
 'renewed_cat_cookie/5137': 3,
 'renewed_cat_cookie/5140': 3,
 'renewed_cat_cookie/5147': 3,
 'renewed_cat_cookie/5156': 3,
 'renewed_cat_cookie/5207': 3,
 'renewed_cat_cookie/5224': 3,
 'renewed_cat_cookie/5225': 3,
 'renewed_cat_cookie/5261': 3,
 'renewed_cat_cookie/5266': 3,
 'renewed_cat_cookie/5272': 3,
 'renewed_cat_cookie/5286': 3,
 'renewed_cat_cookie/5288': 3,
 'renewed_cat_cookie/5295': 3,
 'renewed_cat_cookie/5310': 3,
 'renewed_cat_cookie/5328': 3,
 'renewed_cat_cookie/5330': 3,
 'renewed_cat_cookie/5337': 3,
 'renewed_cat_cookie/5350': 3,
 'renewed_cat_cookie/5368': 3,
 'renewed_cat_cookie/5370': 3,
 'renewed_cat_cookie/5371': 3,
 'renewed_cat_cookie/5379': 3,
 'renewed_cat_cookie/5403': 3,
 'renewed_cat_cookie/5452': 3,
 'renewed_cat_cookie/5470': 3,
 'renewed_cat_cookie/5486': 3,
 'renewed_cat_cookie/5498': 3,
 'renewed_cat_cookie/5499': 3,
 'renewed_cat_cookie/5532': 3,
 'renewed_cat_cookie/5536': 3,
 'renewed_cat_cookie/5541': 3,
 'renewed_cat_cookie/555': 3,
 'renewed_cat_cookie/557': 3,
 'renewed_cat_cookie/5570': 3,
 'renewed_cat_cookie/5604': 3,
 'renewed_cat_cookie/5607': 3,
 'renewed_cat_cookie/5648': 3,
 'renewed_cat_cookie/568': 3,
 'renewed_cat_cookie/5680': 3,
 'renewed_cat_cookie/5770': 3,
 'renewed_cat_cookie/5784': 3,
 'renewed_cat_cookie/5799': 3,
 'renewed_cat_cookie/5801': 3,
 'renewed_cat_cookie/5811': 3,
 'renewed_cat_cookie/5820': 3,
 'renewed_cat_cookie/5829': 3,
 'renewed_cat_cookie/5873': 3,
 'renewed_cat_cookie/5922': 3,
 'renewed_cat_cookie/5954': 3,
 'renewed_cat_cookie/5959': 3,
 'renewed_cat_cookie/5962': 3,
 'renewed_cat_cookie/5989': 3,
 'renewed_cat_cookie/6015': 3,
 'renewed_cat_cookie/6028': 3,
 'renewed_cat_cookie/6038': 3,
 'renewed_cat_cookie/6049': 3,
 'renewed_cat_cookie/6059': 3,
 'renewed_cat_cookie/608': 3,
 'renewed_cat_cookie/6080': 3,
 'renewed_cat_cookie/6177': 3,
 'renewed_cat_cookie/6211': 3,
 'renewed_cat_cookie/6225': 3,
 'renewed_cat_cookie/623': 3,
 'renewed_cat_cookie/6248': 3,
 'renewed_cat_cookie/6253': 3,
 'renewed_cat_cookie/6258': 3,
 'renewed_cat_cookie/6263': 3,
 'renewed_cat_cookie/6270': 3,
 'renewed_cat_cookie/6273': 3,
 'renewed_cat_cookie/6282': 3,
 'renewed_cat_cookie/6283': 3,
 'renewed_cat_cookie/6310': 3,
 'renewed_cat_cookie/6348': 3,
 'renewed_cat_cookie/6357': 3,
 'renewed_cat_cookie/6399': 3,
 'renewed_cat_cookie/6402': 3,
 'renewed_cat_cookie/6414': 3,
 'renewed_cat_cookie/6489': 2,
 'renewed_cat_cookie/6498': 3,
 'renewed_cat_cookie/6522': 3,
 'renewed_cat_cookie/6526': 3,
 'renewed_cat_cookie/6529': 3,
 'renewed_cat_cookie/6546': 3,
 'renewed_cat_cookie/6567': 3,
 'renewed_cat_cookie/6581': 3,
 'renewed_cat_cookie/6602': 3,
 'renewed_cat_cookie/6608': 3,
 'renewed_cat_cookie/6645': 3,
 'renewed_cat_cookie/6698': 3,
 'renewed_cat_cookie/6803': 3,
 'renewed_cat_cookie/6805': 3,
 'renewed_cat_cookie/6807': 3,
 'renewed_cat_cookie/6833': 3,
 'renewed_cat_cookie/6856': 3,
 'renewed_cat_cookie/6870': 3,
 'renewed_cat_cookie/6875': 3,
 'renewed_cat_cookie/692': 3,
 'renewed_cat_cookie/6937': 3,
 'renewed_cat_cookie/7010': 3,
 'renewed_cat_cookie/7012': 3,
 'renewed_cat_cookie/7028': 3,
 'renewed_cat_cookie/7070': 3,
 'renewed_cat_cookie/7084': 3,
 'renewed_cat_cookie/7086': 3,
 'renewed_cat_cookie/7133': 3,
 'renewed_cat_cookie/7198': 3,
 'renewed_cat_cookie/7235': 3,
 'renewed_cat_cookie/7236': 3,
 'renewed_cat_cookie/7260': 3,
 'renewed_cat_cookie/7265': 3,
 'renewed_cat_cookie/7274': 3,
 'renewed_cat_cookie/7314': 3,
 'renewed_cat_cookie/7318': 2,
 'renewed_cat_cookie/7323': 3,
 'renewed_cat_cookie/7346': 3,
 'renewed_cat_cookie/7352': 3,
 'renewed_cat_cookie/7391': 3,
 'renewed_cat_cookie/7392': 3,
 'renewed_cat_cookie/7396': 3,
 'renewed_cat_cookie/7401': 3,
 'renewed_cat_cookie/744': 3,
 'renewed_cat_cookie/75': 3,
 'renewed_cat_cookie/7613': 3,
 'renewed_cat_cookie/7617': 3,
 'renewed_cat_cookie/7649': 3,
 'renewed_cat_cookie/7657': 3,
 'renewed_cat_cookie/766': 3,
 'renewed_cat_cookie/7673': 3,
 'renewed_cat_cookie/7687': 3,
 'renewed_cat_cookie/77': 3,
 'renewed_cat_cookie/772': 3,
 'renewed_cat_cookie/7734': 3,
 'renewed_cat_cookie/7737': 3,
 'renewed_cat_cookie/7746': 3,
 'renewed_cat_cookie/7770': 3,
 'renewed_cat_cookie/7779': 3,
 'renewed_cat_cookie/7811': 3,
 'renewed_cat_cookie/7816': 3,
 'renewed_cat_cookie/7857': 3,
 'renewed_cat_cookie/7893': 3,
 'renewed_cat_cookie/7909': 3,
 'renewed_cat_cookie/7913': 3,
 'renewed_cat_cookie/7920': 3,
 'renewed_cat_cookie/7943': 3,
 'renewed_cat_cookie/7959': 3,
 'renewed_cat_cookie/8056': 3,
 'renewed_cat_cookie/8067': 3,
 'renewed_cat_cookie/807': 3,
 'renewed_cat_cookie/8102': 3,
 'renewed_cat_cookie/8120': 3,
 'renewed_cat_cookie/8139': 3,
 'renewed_cat_cookie/8169': 3,
 'renewed_cat_cookie/818': 3,
 'renewed_cat_cookie/8206': 3,
 'renewed_cat_cookie/8227': 3,
 'renewed_cat_cookie/8243': 3,
 'renewed_cat_cookie/8258': 3,
 'renewed_cat_cookie/8261': 3,
 'renewed_cat_cookie/8290': 3,
 'renewed_cat_cookie/8306': 3,
 'renewed_cat_cookie/8316': 3,
 'renewed_cat_cookie/8349': 3,
 'renewed_cat_cookie/8374': 3,
 'renewed_cat_cookie/838': 3,
 'renewed_cat_cookie/8417': 3,
 'renewed_cat_cookie/8421': 3,
 'renewed_cat_cookie/8435': 3,
 'renewed_cat_cookie/8443': 3,
 'renewed_cat_cookie/8446': 3,
 'renewed_cat_cookie/8467': 3,
 'renewed_cat_cookie/847': 3,
 'renewed_cat_cookie/8470': 3,
 'renewed_cat_cookie/8528': 3,
 'renewed_cat_cookie/8571': 3,
 'renewed_cat_cookie/8579': 3,
 'renewed_cat_cookie/8590': 3,
 'renewed_cat_cookie/8600': 3,
 'renewed_cat_cookie/8610': 3,
 'renewed_cat_cookie/8611': 3,
 'renewed_cat_cookie/8614': 3,
 'renewed_cat_cookie/8626': 3,
 'renewed_cat_cookie/8639': 3,
 'renewed_cat_cookie/8655': 3,
 'renewed_cat_cookie/8663': 3,
 'renewed_cat_cookie/8673': 3,
 'renewed_cat_cookie/8694': 3,
 'renewed_cat_cookie/8699': 3,
 'renewed_cat_cookie/8702': 3,
 'renewed_cat_cookie/8734': 3,
 'renewed_cat_cookie/8771': 3,
 'renewed_cat_cookie/8775': 3,
 'renewed_cat_cookie/882': 3,
 'renewed_cat_cookie/8830': 3,
 'renewed_cat_cookie/8838': 3,
 'renewed_cat_cookie/8868': 3,
 'renewed_cat_cookie/8877': 3,
 'renewed_cat_cookie/8886': 3,
 'renewed_cat_cookie/8903': 3,
 'renewed_cat_cookie/8936': 3,
 'renewed_cat_cookie/8942': 3,
 'renewed_cat_cookie/8951': 3,
 'renewed_cat_cookie/8962': 3,
 'renewed_cat_cookie/8963': 3,
 'renewed_cat_cookie/8971': 3,
 'renewed_cat_cookie/8977': 3,
 'renewed_cat_cookie/900': 3,
 'renewed_cat_cookie/9004': 3,
 'renewed_cat_cookie/9026': 3,
 'renewed_cat_cookie/9032': 3,
 'renewed_cat_cookie/9056': 3,
 'renewed_cat_cookie/91': 3,
 'renewed_cat_cookie/9101': 3,
 'renewed_cat_cookie/9148': 3,
 'renewed_cat_cookie/9158': 3,
 'renewed_cat_cookie/9161': 3,
 'renewed_cat_cookie/9162': 3,
 'renewed_cat_cookie/9179': 3,
 'renewed_cat_cookie/9183': 3,
 'renewed_cat_cookie/922': 3,
 'renewed_cat_cookie/928': 3,
 'renewed_cat_cookie/9287': 3,
 'renewed_cat_cookie/9329': 3,
 'renewed_cat_cookie/9341': 3,
 'renewed_cat_cookie/9362': 3,
 'renewed_cat_cookie/9367': 3,
 'renewed_cat_cookie/9368': 3,
 'renewed_cat_cookie/9370': 3,
 'renewed_cat_cookie/9372': 3,
 'renewed_cat_cookie/9414': 3,
 'renewed_cat_cookie/9419': 3,
 'renewed_cat_cookie/9427': 3,
 'renewed_cat_cookie/9439': 3,
 'renewed_cat_cookie/9560': 3,
 'renewed_cat_cookie/9567': 3,
 'renewed_cat_cookie/9571': 3,
 'renewed_cat_cookie/9588': 3,
 'renewed_cat_cookie/9590': 3,
 'renewed_cat_cookie/9598': 3,
 'renewed_cat_cookie/9610': 3,
 'renewed_cat_cookie/9615': 3,
 'renewed_cat_cookie/9626': 3,
 'renewed_cat_cookie/9628': 3,
 'renewed_cat_cookie/9640': 3,
 'renewed_cat_cookie/9656': 3,
 'renewed_cat_cookie/9676': 3,
 'renewed_cat_cookie/968': 3,
 'renewed_cat_cookie/9727': 3,
 'renewed_cat_cookie/9748': 3,
 'renewed_cat_cookie/9763': 3,
 'renewed_cat_cookie/9784': 3,
 'renewed_cat_cookie/9795': 3,
 'renewed_cat_cookie/9796': 3,
 'renewed_cat_cookie/9828': 3,
 'renewed_cat_cookie/9841': 3,
 'renewed_cat_cookie/9844': 3,
 'renewed_cat_cookie/9869': 3,
 'renewed_cat_cookie/9948': 3,
 'renewed_cat_cookie/995': 3,
 'renewed_cat_cookie/9954': 3,
 'renewed_cat_cookie/9959': 3,
 'renewed_cat_cookie/9975': 3,
 'renewed_cat_cookie/9978': 3,
 'renewed_cat_cookie/9979': 3,
 'renewed_cat_cookie/9990': 3,
 'request_depth_max': 9,
 'response_received_count': 44640,
 'responses_per_minute': None,
 'retry/count': 1384,
 'retry/max_reached': 666,
 'retry/reason_count/403 response': 1292,
 'retry/reason_count/500 Internal Server Error': 15,
 'retry/reason_count/503 Service Unavailable': 1,
 'retry/reason_count/504 Gateway Time-out': 8,
 'retry/reason_count/scrapy.core.downloader.handlers.http11.TunnelError': 53,
 'retry/reason_count/twisted.internet.error.TimeoutError': 8,
 'retry/reason_count/twisted.web._newclient.ResponseFailed': 3,
 'retry/reason_count/twisted.web._newclient.ResponseNeverReceived': 4,
 'scheduler/dequeued': 50930,
 'scheduler/dequeued/memory': 50930,
 'scheduler/enqueued': 50938,
 'scheduler/enqueued/memory': 50938,
 'spider_exceptions/AttributeError': 490,
 'spidermon/validation/fields': 19971,
 'spidermon/validation/items': 951,
 'spidermon/validation/validators': 1,
 'spidermon/validation/validators/item/jsonschema': True,
 'spidermon_field_coverage/dict/brand': 1.0,
 'spidermon_field_coverage/dict/categories': 1.0,
 'spidermon_field_coverage/dict/countryOfOrigin': 1.0,
 'spidermon_field_coverage/dict/description': 1.0,
 'spidermon_field_coverage/dict/imageUrl': 1.0,
 'spidermon_field_coverage/dict/inStock': 1.0,
 'spidermon_field_coverage/dict/isFreeShipping': 1.0,
 'spidermon_field_coverage/dict/leadTime': 1.0,
 'spidermon_field_coverage/dict/manufacturer': 1.0,
 'spidermon_field_coverage/dict/manufacturerSku': 1.0,
 'spidermon_field_coverage/dict/name': 1.0,
 'spidermon_field_coverage/dict/packagingIncrement': 1.0,
 'spidermon_field_coverage/dict/prices': 1.0,
 'spidermon_field_coverage/dict/productStatus': 1.0,
 'spidermon_field_coverage/dict/relatedSkus': 1.0,
 'spidermon_field_coverage/dict/specifications': 1.0,
 'spidermon_field_coverage/dict/supplier': 1.0,
 'spidermon_field_coverage/dict/supplierSku': 1.0,
 'spidermon_field_coverage/dict/uom': 1.0,
 'spidermon_field_coverage/dict/url': 1.0,
 'spidermon_field_coverage/dict/weight': 1.0,
 'spidermon_item_scraped_count': 951,
 'spidermon_item_scraped_count/dict': 951,
 'spidermon_item_scraped_count/dict/brand': 951,
 'spidermon_item_scraped_count/dict/categories': 951,
 'spidermon_item_scraped_count/dict/countryOfOrigin': 951,
 'spidermon_item_scraped_count/dict/description': 951,
 'spidermon_item_scraped_count/dict/imageUrl': 951,
 'spidermon_item_scraped_count/dict/inStock': 951,
 'spidermon_item_scraped_count/dict/isFreeShipping': 951,
 'spidermon_item_scraped_count/dict/leadTime': 951,
 'spidermon_item_scraped_count/dict/manufacturer': 951,
 'spidermon_item_scraped_count/dict/manufacturerSku': 951,
 'spidermon_item_scraped_count/dict/name': 951,
 'spidermon_item_scraped_count/dict/packagingIncrement': 951,
 'spidermon_item_scraped_count/dict/prices': 951,
 'spidermon_item_scraped_count/dict/productStatus': 951,
 'spidermon_item_scraped_count/dict/relatedSkus': 951,
 'spidermon_item_scraped_count/dict/specifications': 951,
 'spidermon_item_scraped_count/dict/supplier': 951,
 'spidermon_item_scraped_count/dict/supplierSku': 951,
 'spidermon_item_scraped_count/dict/uom': 951,
 'spidermon_item_scraped_count/dict/url': 951,
 'spidermon_item_scraped_count/dict/weight': 951,
 'start_requests/big_query': 12078,
 'start_time': datetime.datetime(2026, 1, 3, 23, 0, 12, 365069, tzinfo=datetime.timezone.utc)}
2026-01-04 14:30:23 [scrapy.core.engine] (PID: 126) INFO: Spider closed (closespider_timeout_no_item)